Probability Theory #2

This assignment is designed to:

• provide practice with some essential probability theory
• help you become more fluent with the terminology and the techniques
• help you grow in confidence in your mathematical abilities

This is a mathematical homework assignment. Show your work. Be clear and concise. Type your assignment.

I strongly recommend you work through these exercises as soon as possible for their instructional content. If you have general questions about the assignment, please post on the Google Group. Finish early, and earn the early bonus.

[70 points; 35 per sub-problem]

(Adapted from: Manning & Schuetze, p. 59, exercise 2.1)

Use the Set Theory Identities and Axioms of Probability Theory to prove each of the following statements. Develop your proof first in terms of sets and then translate into probabilities; use set theoretic operations on sets and arithmetic operators on probabilities. Be sure to apply good proof technique: justify each step in your proofs; set up your proofs in two-column format, with each step showing a statement on the left and a justification on the right. Remember that in order to invoke an axiom as justification, you must first satisfy the conditions / pre-requisites of the axiom. (See the example proofs page for one example.)

1. $P(\varnothing) = 0$
2. $A \subseteq B \Rightarrow P(A) \leq P(B)$
   • Hint: let $C = B - A$ (set difference).

[15 points]

(Adapted from: Manning & Schuetze, p. 59, exercise 2.4)

$X$ and $Y$ as defined in the following table independently distributed?

2015: improved wording: If the distribution over two random variables $X$ and $Y$ is defined in the following table, are $X$ and $Y$ independently distributed?

[15 points]

Prove the chain rule, namely that $P(\cap^n_{i=1} A_i) = P(A_1)\cdot P(A_2|A_1)\cdot P(A_3|A_1\cap A_2)\cdot \ldots\cdot P(A_n | \cap^{n-1}_{i=1} A_i)$. Justify each step. Use the same standard of proof as in problem #1 above.

• Hint: you could use induction (but that isn't the only way).

Submit a .pdf document through Learning Suite.