Independence and Negation

Two events A,B are said to be statistically independent if and only 
if
                  P(A and B) = P(A)P(B)

Intuitively it's clear that if A and B are independent events, then
A and B' (the negation of B) must also be independent.  To demonstrate
this formally, notice that we have

    P(B)  +  P(B') = 1       and       P(B|A) + P(B'|A) = 1

Therefore, on the assumption that A and B are independent, so (1)
applies, and recalling that P(A and B) = P(A) P(B|A) for any two 
events A and B, we have P(B) = P(B|A), from which it follows (in
view of the two preceding identities) that P(B') = P(B'|A), and 
so P(A and B') = P(A) P(B'), which confirms that A and B' are
independent.

A more direct approach, pointed out by Noel Vaillant, avoiding the
use of conditional probabilities, is to note that 

     P(A)  =  P(A and (B or B'))  =  P(A and B) + P(A and B')

Since, by assumption, P(A and B) = P(A)P(B), it follows immediately 
that

      P(A and B')  =  P(A) - P(A)P(B)  =  P(A)P(B')

We can also consider this as a geometrical proposition.  Suppose
A and B are overlapping regions of an overall region S as shown
below.

       

Let a,b,c,d denote the areas of the enclosed regions as shown in
this figure.  Regarding the total region S as the "sample space",
the overall content of this space is a+b+c+d, and we can use this
to normalize each of the other areas.  Hence, the normalized areas
of the various regions are

          a+b+c+d             a+c               b+c
      S = -------       A = -------       B = -------
          a+b+c+d           a+b+c+d           a+b+c+d


                                   c
            Intersection(A,B) = -------
                                a+b+c+d

The condition corresponding to "independence of A and B" is that the
normalized area of the intersection of A and B equals the product of 
the normalized areas of A and B, as follows

             c         /   a+c   \  /   b+c   \
          -------  =  (  -------  )(  -------  )
          a+b+c+d      \ a+b+c+d /  \ a+b+c+d /

This reduces to the simple condition 

                           ab = cd

We can also evaluate the product of the normalized areas of A and 
the S-complement of B as follows

      /   a+c   \  /   a+d   \        a^2 + ac + ad + cd
     (  -------  )(  -------  )   =   ------------------
      \ a+b+c+d /  \ a+b+c+d /            (a+b+c+d)^2

Now, under the condition of "independence" of A and B, we can
substitute ab for cd in the right-hand expression, which gives

          a^2 + ac + ad + ab            a
          ------------------    =    -------
              (a+b+c+d)^2            a+b+c+d

This, as expected, is the normalized area of the intersection of A
with the S-complement of B, implying that these two regions also
satisfiy the mutual "independence" condition.

Return to MathPages Main Menu