This shows you the differences between two versions of the page.

Link to this comparison view

cs-401r:influence-in-bayes-nets [2014/10/13 16:56] (current)
cs401rpml created
Line 1: Line 1:
 +==Tutorial: Influence in Bayes Nets==
 +The arrows in a directed graphical model indicate how to factor the joint distribution over the variables in the model. They indicate explicit dependence. You can think of the relationship indicated by an arrow $A \rightarrow B$ as "$A$ causes $B$".
 +===Conditional Independence===
 +The “grand unifying principle” for reading influence in a Bayes net (directed graphical model) applies between any pair of nodes in a model: (1) Two nodes (random variables) $A$ & $B$ are conditionally independent,​ given their parents, if and only if there is no direct arrow between the two nodes (in either direction).
 +*Note that this statement does not make any guarantees about conditional independence between $A$ & $B$ given other non-parent nodes.
 +One node (random variable) $A$ is said to influence another node (random variable) $B$ if and only if a conditional query
 +$P(B = b|A = a)$ produces an expression that after algebraic simplification still depends on the value $a$.
 +===Explaining Away===
 +In particular, as an example of influence we consider the explaining away structure ($A \rightarrow C$ and $B \rightarrow C$). Here we ask “Does $A$ influence $B$, given $C$?” Since $C$ is not a parent of either $A$ or $B$, then statement (1) does not apply. So, using statement (2), we ask the conditional query $P(B = b|A = a,C = c)$. We do the computation required for a conditional query: first apply the definition of conditional probability,​ then use marginalization (as necessary) for numerator and for the denominator,​ then simplify algebraically. ​ Here the meaning of algebraic simplification includes at least factoring out common terms from sums, simplifying sums, and canceling common terms that occur in both numerator and denominator. ​ The result is an expression that does indeed depend on the value $a$, thus the answer to the original question is “Yes, $A$ does influence $B$, given $C$.”
cs-401r/influence-in-bayes-nets.txt · Last modified: 2014/10/13 16:56 by cs401rpml
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0