In this lab, you will implement:

  1. Simple exact inference
  2. Pruning based on d-separability

Exact inference

Build a simple script or even a spread sheet that infers the distributions given below. Keep this very simple and specific to this case. You do not need to read in the probabilities and solve problems in general. You can even do it by hand if you really want to.

Do not over engineer your solution. Just building a table for the joint distribution of A, B, C, and D and Sum to obtained the needed probabilities. Please do NOT just down load a package to do it for you; the point right now is to understand where all the numbers go and what they mean. You are encouraged (not required) to download a package to test your answer.

Just turn in your answers (see “Find” below)

Topology:

  1. B depends on A (A→B)
  2. C depends on B and D (B→C and D→C)
  3. A and D depend on nothing

Variables:

  1. A, C, and D are Boolean
  2. B can take 3 values 1, 2, or 3

Probabilities:

  1. P(A=t) = 0.1
  2. P(B=1|A=t) = 0.2
  3. P(B=2|A=t) = 0.3
  4. P(B=1|A=f) = 0.4
  5. P(B=2|A=f) = 0.5
  6. P(C=t|B=1,D=t) = 0.6
  7. P(C=t|B=1,D=f) = 0.7
  8. P(C=t|B=2,D=t) = 0.8
  9. P(C=t|B=2,D=f) = 0.9
  10. P(C=t|B=3,D=t) = 0.11
  11. P(C=t|B=3,D=f) = 0.21
  12. P(D=t) = 0.31

Find

  1. p(B=1 | C=t, D=f)
  2. p(B=1 | C=t, D=t)

Pruning

Expand on the idea of d-separation to build code that will take as input:

  • a Bayesian network
  • a set of query variables
  • a set of evidence variables

And return a sub-network which does not contain any variables not needed for the query.

Is is not necessary for you to build a parser to read in the network. Just encode the structure in your code. If you really insist on parsing a file format you might look at any of the many Bayesian network file formats. You may also just use the dot format (see ://www.graphviz.org/). You may use code from the internet for your input and output routines, as long as you abide by the license that covers that code and that the license does not affect my ability to grade the code. Of course getting d-separation code from the net is not allowed, since that is the point of the exercise.

Please test your code on a variety of networks of your own making, or ones you find on the web. Be sure that you test your code on networks that include the following:

  • Influence that flows forward (i.e. evidence→node a→node b→Query node)
  • Influence that flows backward (i.e. evidence←node a←node b←Query node)
  • Influence that flows through “v” structures (i.e. node a→evidence←Query node)
  • Influence that flows through “y” structures (i.e. node a→node b←Query node and node b→evidence)
  • Influence that flows through “inverted-v” structures (i.e. evidence←node a→Query node)
  • Mixed sequences of these structures
  • Multiple Evidence nodes
  • Multiple Query nodes
  • Multiple paths from the Evidence to the Query, some active, some not.

You are encouraged to share interesting structures on the discussion page, but don't share the answers. You are likewise encouraged to use these shared structures when you turn in your assignment. Please identify which structures you contributed to the class and which you obtained from others.

Please turn in the following:

  • A short (less than one page) description of how your algorithm works.
  • Sample runs some of which should have significantly more than 10 nodes. Note that you have the obligation to show me that your approach works correctly, you will need some small runs to convince me.
  • Give a summary of a run with an 'impressive' number of nodes. How big a network can your code effectively work on? What is the big-O of your algorithm?
  • A summary of your thoughts on your algorithm and why it is important
  • Source code

Please submit this by e-mail.

Grading Rubric for the Report

Your report will be graded out of 100 points, which will be assigned as follows:

  • 5 points for the correct answer on the exact inference problem
  • 20 points for your description of your algorithm
  • 10 points for your demonstration of the algorithm on small graphs (the test cases listed above are particularly important in demonstrating correctness)
  • 10 points for demonstrating correctness on medium sized graphs (the “more than 10 nodes” part mentioned above)
  • 10 points for running your code on big nodes (the “impressive” category above)
  • 10 points for your Big-O analysis
  • 5 points for your summary
  • 30 points for the correctness of the algorithm (as determined by your demonstrations in your paper - be sure you are convincing!)

Please turn in a professional-looking report. A sloppy paper or failure to follow directions in other ways will lose you points on your report.

cs-677sp2010/pruning-lab.txt · Last modified: 2014/12/12 13:34 by ryancha
Back to top
CC Attribution-Share Alike 4.0 International
chimeric.de = chi`s home Valid CSS Driven by DokuWiki do yourself a favour and use a real browser - get firefox!! Recent changes RSS feed Valid XHTML 1.0