Zum Inhalt springen

Generated sigma-algebras

Aus Wikibooks

In this article we learn what the σ algebra generated by a set system is. We prove some important properties and get to know the Borel σ-algebra.

Motivation

[Bearbeiten]

Let 𝒞 be a set system over a basic set Ω and μ:𝒞[0,] a function on sets. Our goal is to find out how and under what conditions μ can be continued to a measure on a reasonable σ-algebra 𝒜.

A continuation must be defined at least on the domain of definition of the function to be continued. Therefore, the set system 𝒞 must be contained in 𝒜.

One possibility would be to choose by default the power set 𝒫(Ω) as domain of definition of the continuation (i.e., the largest possible domain): It is a σ algebra and contains 𝒞. But this is not always a sensible choice:

  • The power set is in general too ambitious a target for a continuation: the volume problem shows that with intuitive geometric volumes there can be problems defining them on the whole power set. So the power set may be too large to continue a measure to it.
  • The power set may also be unnecessarily large: compared to the set system 𝒞, 𝒫(Ω) may contain too many sets to which continuation then makes no sense. A simple example for this case is when μ is a measure and 𝒞 itself is already a σ algebra, but not the power set.

A concrete example for the second point is the following:

Example (Reasonable extension of 𝒞)

Let Ω={1,2,3,4} and 𝒞={{1,2},{3,4}}. Let further μ be a function defined on the set of sets 𝒞 with μ({1,2})=1=μ({3,4}). The set system

𝒜:=𝒞{Ω}{}

is a σ-algebra containing 𝒞. But of course the power set 𝒫(Ω) is also such a σ-algebra. Intuitively, however, 𝒫(Ω) makes little sense as a domain of definition of a continuation ν of μ. This is because the power set also contains the one-element subsets of Ω. However, μ does not provide any information about these at all: we could arbitrarily choose the value for ν({1}) from [0,1]. A larger value is not possible because of monotonicity, since ν({1})μ({1,2})=1 must hold. Then, because of additivity, ν({2})=1ν({1}).

The σ-algebra 𝒜 we are looking for should therefore not be larger than necessary. We have already stated above that it should, however, contain at least the set system 𝒞. So we first consider all super-σ-algebras of 𝒞, i.e., all σ-algebras containing 𝒞. To find the smallest among these, we proceed as in constructing the (topological) closure of a set: The closure of a set is the smallest closed superset and is defined as a section over all closed supersets. Analogously, we choose the smallest super-σ-algebra 𝒜 of 𝒞 to be the intersection over all these σ-algebras.

Definition: Generated σ-algebra

[Bearbeiten]

The σ-algebra, which we defined in the previous section as the intersection over all super-σ-algebras of 𝒞, is called generated σ-algebra:

Definition (Generated σ-algebra)

Let Ω be a set and 𝒞𝒫(Ω) be a set system. The σ-algebra

σ(𝒞):={𝒫(Ω): is a σ-algebra, 𝒞}

is called the σ algebra generated by 𝒞. The "operator of generation σ" defined by it is called the σ operator. The set system 𝒞 is called generator of σ(𝒞).

Hint

{𝒫(Ω): is a σ-algebra, 𝒞}

is another notation for the intersection , where ={𝒫(Ω): is a σ-algebra, 𝒞}.

Hint

Although there is no Ω in σ(𝒞), the σ algebra σ(𝒞) generated of a set system 𝒞 depends of course on the underlying basic set Ω. Let, for instance 𝒞={}. Then σ(𝒞)={,Ω} is the σ algebra generated by 𝒞 over Ω. For another basic set Ω this is a different set system. Often, the Ω is clear from the context and is therefore omitted in the notation of the σ operator.

Hint

One can also define other kinds of generated set systems according to the same principle. For example, one can define the ring or σ-ring generated by a set system 𝒞.

We still need to verify that the generated σ-algebra is well-defined, that is, that the definition makes sense. To do this, we need to show:

  • The set over which the intersection is formed is not empty. That is, there is at least one σ-algebra containing 𝒞.
  • σ(𝒞) is indeed a σ-algebra.

The first point is clear since the power set 𝒫(Ω) is a σ-algebra containing 𝒞. For the proof of the second point, we have to prove that the intersection of arbitrary many σ-algebras is always a σ-algebra again. Then, we have that σ(𝒞) as a section over certain σ-algebras is indeed a σ-algebra.

Theorem (The intersection of σ-algebras is again a σ-algebra.)

Let be a non-empty set of σ-algebras over Ω. That is, every element in is a σ-algebra. Then 𝒜:= is a σ-algebra.

Proof (The intersection of σ-algebras is again a σ-algebra.)

We need to prove that 𝒜 satisfies the three properties of a σ-algebra:

  1. Ω𝒜
  2. A𝒜A𝒜
  3. A1,A2,𝒜nAn𝒜

The basic set Ω is in 𝒜: Each element of is a σ-algebra over Ω and thus contains the basic set. Thus Ω is also contained in the section over all these elements, i.e. in 𝒜.

Complement stability: Let A𝒜 be arbitrary. By definition of 𝒜, A lies in the intersection of all σ algebras from . We conclude A for all . Since every is a σ-algebra, the complement A also lies in for all . Thus A is also in the section over all these σ-algebras, that is, in 𝒜.

Completeness under countable unions: Let A1,A2,𝒜. By definition of 𝒜 these sets lie in the intersection of all σ-algebras from , so we have that A1,A2, for all . Since every is a σ-algebra and hence complete under formation of countable unions, every from also contains the union nAn. Thus this union also lies in the section over all these σ-algebras from , i.e. in 𝒜.

We have now shown that σ(𝒞) is a σ-algebra. Intuitively, it should be the smallest σ-algebra containing the set system 𝒞. We prove this in the next section "Properties of the σ-operator".

Properties of the σ-operator

[Bearbeiten]

We establish some useful properties of the σ-operator:

Theorem

Let 𝒞,𝒫(Ω) be a set system. The σ-operator now satisfies the following properties:

  1. Extensivity: 𝒞σ(𝒞)
  2. Minimality:σ(𝒞) is the smallest σ-algebra containing 𝒞. If 𝒞 is a σ-algebra, then σ(𝒞)=𝒞.
  3. Idempotency: σ(σ(𝒞))=σ(𝒞)
  4. Monotonicity: 𝒞σ(𝒞)σ()

Proof

  1. Extensivity: By definition, 𝒞 is subset of every σ-algebra over which we take the intersection in the definition of the σ-operator. That is, for any A𝒞, A is element every σ-algebra over which we intersect. Then A is also element of the intersection of all these σ-algebras, which is exactly σ(𝒞). Since this is true A𝒞, we have 𝒞σ(𝒞).
  2. Minimality: Let 𝒢 be a σ-algebra with 𝒞𝒢. Since 𝒢 is one of the sets over which we intersect in the definition of σ(𝒞), we have that σ(𝒞)={𝒫(Ω): is a σ-algebra, 𝒞}𝒢. If 𝒞 is a σ-algebra we may readily conclude σ(𝒞)𝒞. From extensivity we obtain the other inclusion and therefore we have 𝒞=σ(𝒞).
  3. Idempotency: The idempotency follows directly from the minimality. We have that σ(𝒞) is always a σ-algebra, and therefore we have σ(𝒞))=σ(𝒞).
  4. Monotonicity: Let 𝒞. Then, we have 𝒞σ() due to extensivity. Since σ() is a σ-algebra, it follows from minimality that σ(𝒞)σ() holds.

Hint

The properties 1., 3. and 4. (extensivity, idempotency and monotonicity) make the σ-operator an enveloping operator (it determines the envelope of a set, like wrapping a gift), just as the closure "¯" of sets turning "A" into "A¯".

Examples

[Bearbeiten]

In the section "Motivation" we have seen a first example for a generated σ-algebra: Let Ω={1,2,3,4} and 𝒞={{1,2},{3,4}}. Then σ(𝒞)=𝒞{Ω}} is the σ-algebra generated by 𝒞: 𝒞{Ω}{} is a σ-algebra and the smallest one containing 𝒞. Another example for a finitely generated σ-algebra is the following:

Example

If one wants to describe the probability of the occurrence of events when rolling a dice by using a measure, the domain of definition is the σ-algebra, which contains all elementary events. These are all one-element subsets {x} of the basic set Ω={1,,6}. The σ-algebra generated by the set 𝒞={{1},,{6}} generated is the power set 𝒫(Ω).

The σ-algebra of the one-element subsets of a countable basic set often appears in discrete probability theory as a domain of definition of the distribution of discrete random variables. In this case of a discrete, i.e. countable basic set (such as Ω={0,1},Ω={1,,n} or Ω=), the σ-algebra generated by these elementary events is the power set 𝒫(Ω). So actually, introducing σ-algebras would not be necessary. However, the situation is different if the basic set is over-countable, like :

Theorem (σ-algebra over generated by point sets)

Let Ω= be the basic set. The σ-algebra generated from the set of one-element subsets ={{x}x} is 𝒜={AA or A countable}.

Proof (σ-algebra over generated by point sets)

We perform the proof in two steps. First, we show that 𝒜 is a σ algebra containing , i.e., 𝒜 holds. Next we show 𝒜σ(). Then we conclude 𝒜=σ().

Proof step: 𝒜 is a σ-algebra containing

The elements from (which are subsets of the basic set) contain only one-element each. Thus, they are countable. It follows directly that every element from is also contained in 𝒜, so 𝒜. We now show that 𝒜 is a σ-algebra. To do this, we check the three criteria:

Ω𝒜 is of course satisfied, since Ω= is countable.

If A𝒜, then A is countable or A is countable. In case 1, (A)=A is countable, so it is contained in 𝒜. In case 2, A has a countable complement, so A=(A) is contained in 𝒜.

Let now nAn a union of sets from 𝒜. Then we distinguish two cases. In case 1, for at least one k the set Ak has countable complement. But then (nAn)Ak as a subset of a countable set is also countable and hence contained in 𝒜. In case 2 for all n the set An is countable. Then, of course, their union nAn is countable and hence contained in 𝒜.

Thus 𝒜 is really σ-algebra and it contains .

Proof step: 𝒜σ()

Let A𝒜 be arbitrary. Then we distinguish two cases. In case 1, A is countable. Consider A=n{xn} as a countable union of sets from . Then A is in particular also a countable union of sets in σ() and because of the union stability of σ-algebras with respect to countable unions, it follows that Aσ(). In case 2 A is countable, so according to case 1 it is contained in σ(). From the complement stability of σ() it now follows that also Aσ() is true.

We have that also 𝒜σ(). Following the monotonicity of the σ-operator, we have that σ()σ(𝒜)σ()). Since 𝒜 and σ() are already σ-algebras, it follows from the minimality of the σ operator that

σ()𝒜σ() holds true, i.e. 𝒜=σ().

Some σ algebras are so large that they cannot be written down explicitly, as in the previous examples. They can then only be characterized by the generator. An example for this is the σ-algebra generated by the intervals over , which is an often-used but very rich example.

Example (σ-algebra generated by intervals or cuboids)

The geometric length is the function over which assigns to all intervals (a,b), respectively, (a,b], [a,b], [a,b) their length ba. We do not yet know whether this function can be continued to a measure on a σ-algebra. But a reasonable domain of definition of such a continuation would then be the σ-algebra generated of all such intervals, i.e. σ(𝒞)𝒫(Ω) with 𝒞={II interval}.

More generally, one can consider the geometric volume that assigns to all axis-parallel cuboids in n their volume, i.e., the product of the side lengths. A cuboid is a product Q=k=1nIk of intervals Ik (open, half-open or closed). Again, we do not yet know whether this set function can be continued to a measure. But a reasonable domain of definition for a continuation would then be the σ-algebra σ(𝒞), generated by the set system of cuboids 𝒞={QnQ axis-parallel cuboid}.

To-Do:

Link to the article where a continuation from one to the other function above is defined.

Proving that two set systems generate the same σ-algebra

[Bearbeiten]

It is common to want to find out whether two σ-algebras 𝒜 and are equal. For this we would prefer to simply show mutual inclusion directly, i.e. to prove 𝒜 and 𝒜. But if 𝒜, were defined only by generators σ(𝒞),σ(), this is not an easy job. We would have to take any set M𝒜 in the inclusion proof and show that also M holds. The problem is that in general, -sets look very complicated, so we do not know what such set looks like and what properties it has. We only know that it is contained in every superset-σ-algebra of 𝒞. However, we know what the generators look like. So it is way easier to just show that the generators are included in each other. This is what we will do now.

Subset-relations for generators

[Bearbeiten]

Theorem

Let 𝒜, be σ-algebras and let 𝒞 be a generator of 𝒜 (that is a set 𝒞 with σ(𝒞)=𝒜). Now if the producer 𝒞 of 𝒜 is a subset of , then also our σ-algebra 𝒜 is already a subset of the σ-algebra . That is 𝒞𝒜.

Proof

First we see that from the minimality of the σ-operator, we get σ()=. Now we use the monotonicity of the σ-operator: 𝒜=σ(𝒞)σ()=.

Thus we have already simplified our problem considerably. We no longer need to show for arbitrary sets M𝒜 that M is true (which might be a great mess to do). It suffices to prove the inclusion for sets from the generator 𝒞 of 𝒜.

The opposite inclusion can be simplified using the same principle. That is, instead of showing for any M that M𝒜 holds (again, a great mess), we take a generator of and show for all M that M𝒜 is satisfied.

Proving that a set is contained in a σ-algebra

[Bearbeiten]

We now know that it suffices to show only for the sets from the generator that they lie in the respective other σ-algebra. But how can we prove in general for a set M that it lies in a certain σ-algebra 𝒜=σ()?

We know that 𝒜 is closed under the operations complement and countable union (and hence also under taking differences and countable cuts). Therefore every set generated by these operations from sets of the generator is again in 𝒜. Thus, to prove that a set M is in 𝒜, it suffices to take some sets from the generator and write it as an outcome of some set operations between those sets.

Since σ-algebras can be very large, however, there is no general method to find such a representation of M over the sets from the generator.

Example: The σ-algebra generated by intervals

[Bearbeiten]

We will now demonstrate this principle with an example.

Theorem

Consider the set system 𝒞={[a,b) |a,b}, 𝒟={(a,b) |a,b}, ={[a,b] |a,b}. Then, we have σ(𝒞)=σ(𝒟)=σ(). Now, the set system ={I|I interval } generates the same σ-algebra.

Proof

We show σ(𝒞)σ()σ(𝒟)σ(𝒞), since then the claim of the theorem follows.

Proof step: σ(𝒞)σ()

It is enough according to the previous theorem to show that 𝒞σ(𝒟) holds. Let also [a,b)𝒞. Then [a,b] and also [b,b]={b}σ(). Because of the diference stability of σ() then also [a,b)=[a,b]{b}σ(). Since [a,b)𝒞 was arbitrary, it follows that 𝒞σ(), and from this follows the claim of this proof step.

Proof step: σ()σ(𝒟)

We show again σ(𝒟). Let for this [a,b]. The sets (,a)=n,n1(an,a) and (b,)=n,n1(b,b+n) are also in σ(𝒟) as countable unions of sets from σ(𝒟). The union (,a)(b,) is contained (again because of union stability) in σ(𝒟), and with the complement stability of σ(𝒟) then follows [a,b]𝒟. Since [a,b]𝒟 was arbitrary, it follows that 𝒟.

Proof step: σ(𝒟)σ(𝒞)

As in the other two proof steps, we again show 𝒟σ(𝒞). Let for this (a,b)𝒟 be arbitrarily. We have that then for all n, n1 the set [a+1/n,b)𝒞. Then, because of the union stability with respect to countable unions, (a,b)=n,n1[a+1/n,b)σ(𝒞). Since (a,b)𝒟 was arbitrary, it follows 𝒟σ(𝒞), and hence also σ(𝒟)σ(𝒞).

Thus σ(𝒞)=σ(𝒟)=σ(). It makes sense in the following to define :=σ(𝒞)=σ(𝒟)=σ().

Proof step: σ()=

We now show that ={I|I interval } also generates this σ algebra.

Because of the monotonicity, from 𝒞 directly follows =σ(𝒞)σ(). For the other set inclusion we again show, according to our principle, . Let for this I be arbitrarily. We can assume that I is bounded, because if it was not, we could write I as a countable union of bounded intervals and thus reduce the statement to the bounded case. That means there are a,b, so that, one of the 4 following cases occurs

I=[a,b),

I=(a,b),

I=[a,b],

or I=(a,b].

In the first three cases I is contained in a known generator from , and hence also in . In the case I=(a,b] I=n,n1[a+1/n,b] as countable unions of sets in lies again in . Since I was arbitrarily chosen from , it follows that . Thus finally obtain σ().

Both inclusions are shown and we have that σ()=.

Generators of the Borel σ-algebra

[Bearbeiten]

We now apply the principle of the last section to a very important example, namely the so-called Borel σ-algebra.

Theorem (Different generators of the Borel σ-algebra on real numbers)

Let 𝒞={i=1n[ai,bi)nai,bi and 1in}𝒫(n). Then, we call =σ(𝒞) the Borel σ-algebra over n. We show that is equivalently generated by the following set systems: 𝒟={Un|U open}, ={AnA closed}. That means, =σ(𝒞)=σ(𝒟)=σ().

Proof (Different generators of the Borel σ-algebra on real numbers)

We prove that σ(𝒞)σ()σ(𝒟)σ(𝒞). Then all these σ-algebras must be equal.

Proof step: σ(𝒟)σ(𝒞)

As proved in the previous theorem, it suffices to show that 𝒟σ(𝒞) holds. Let also U𝒟 be chosen arbitrarily. Our idea is to represent U as a countable union of sets from σ(𝒞).

Let for x=(x1,x2,,xn)n and q the set A(x,q):=[x1q,x1+q)×[x2q,x2+q)××[xnq,xn+q). Then M=q,xn,A(x,q)UAx,q is a countable union of elements of σ(𝒞), and thus because of the stability of union with respect to countable sets of σ-algebras, also an element of σ(𝒞).

We now show that M=U.

M, as it is as union of subsets of U, is of course also a subset of U, i.e. MU.

For the opposite inclusion let xU be arbitrary. We will now cleverly construct a half-open cube Ax,q with rational side length and rational center such that xAx,qU is fulfilled.

Since U is open, U is also open with respect to the maximum norm. In the following, let Uc(x) always be the c-environment of x with respect to the maximum norm. There exists then an ε>0 with Uε(x)U because U is open.

Let p, 0<p<ε. Then, we have Up(x)Uε(x)U. Let q=p4. Since n is dense in n, there is now xUq(x)n. It follows conversely that xUq(x)Ax,q. Moreover, Ax,qU2q(x)U4q(x)=Up(x)U.

Thus Ax,q is one of the sets over which we take the union in the definition of M. So xAx,qM. Since x was arbitrarily chosen from U, we have UM and consequently U=Mσ(𝒞).

Since U𝒟 was arbitrary, 𝒟σ(𝒞), from which σ(𝒟)σ(𝒞) follows.

Proof step: σ()σ(𝒟)

We show again σ(𝒟). To do this, let A be arbitrary, i.e., A is closed. We then have that by definition A is open, so A𝒟σ(𝒟). Then, because of the complement stability of σ-algebras, A=(A)σ(𝒟).

Since A was arbitrary, it also follows that σ(𝒟) and hence σ()σ(𝒟).

Proof step: σ(𝒞)σ()

We proceed as in Step 1 and 2 and show 𝒞σ().

Let A=[a1,b1)××[an,bn)𝒞 be arbitrarily. Let A=[a1,b1]××[an,bn]. Then A is closed, so Aσ(). We now define n sets as follows: for i=1,,n let Fi=[a1,b1]××[ai1,bi1]×{bi}×[ai+1,bi+1]××[an,bn]. Then these Fi are closed sets, so we have that also Fiσ(). The Fi are the "missing" (n1)-dimensional side faces of the n-dimensional half-open cuboid A.

Further we have that A=A(n=1,,nFi).

Since σ() is difference stable and union stable with respect to countable unions (it is a σ-algebra), it follows that Aσ().

Since this is true for any A𝒞 ,we have 𝒞σ() and therefore σ(𝒞)σ().

Now we have that as previously considered, σ(𝒞)σ()σ(𝒟)σ(𝒞) and from this follows =σ(𝒞)=σ(𝒟)=σ(). That means, the Borel σ-algebra is generated from the set of half-open cuboids, or equivalently fro the set of closed sets or the set of open sets.

Hint

In the theorem we represented the Borel σ-algebra as the σ-algebra generated by the set system 𝒞={i=1n[ai,bi)nai,bi and 1in} of the right-open cuboids. One can show that the following systems of cuboids also generate the Borel σ-algebra:

  • the set system of open cuboids {i=1n(ai,bi)nai,bi and 1in}.
  • the set system of closed cuboids {i=1n[ai,bi]nai,bi and 1in}.
  • the set system of left open cuboids {i=1n(ai,bi]nai,bi and 1in}.
  • the set system of all cuboids {i=1nIinIi interval and 1in}.

In the section "Examples" above, we already encountered the last mentioned set system, as well as the σ-algebra generated by it.

Hint

We now know that the Borel σ-algebra on n is also generated by all open or by all closed subsets of n. One can define more generally the Borel σ-algebra on a topological space as the σ-algebra generated by all open sets (note that the "topology" is just this "set of all open sets") . On n, this agrees with our definition.

The Borel σ-algebra is one of the most important σ-algebras in mathematics. It plays the role of the "smallest and simplest σ-algebra, where stuff makes sense". We will encounter it later in the construction of the Lebesgue measure, again.

To-Do:

Link to the article, where the Borel σ-algebra is treated in detail.