See also: the course schedule on [http://learningsuite.byu.edu Learning Suite]. Note: the PowerPoint slides also contain hidden slides that were not used in class. {| ! # ! Date ! PDF ! PowerPoint ! Screencast ! Supplement ! Title |- | 1 | 9/3/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture01-prob.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture01-prob.pptx PPTX] | --- | --- | Course Introduction; Review of Prob. Theory |- | 2 | 9/5/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture02-prob2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture02-prob2.pptx PPTX] | --- | --- | Independence, Conditional Independence |- | 3 | 9/8/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture03-prob3.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture03-prob3.pptx PPTX] | --- | --- | Bayes Law, Rule of Total Probability |- | 4 | 9/10/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture04-randomvars.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture04-randomvars.pptx PPTX] | --- | --- | Random Variables, Expected Values |- | - | 9/10/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture04-extra-iteration.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture04-extra-iteration.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture04-extra-iteration/Lecture04-extra-iteration.html All] | --- | Bonus lecture on iteration in mathematical expressions |- | 5 | 9/12/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture05-randomvars2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture05-randomvars2.pptx PPTX] | --- | --- | Properties of Random Variables; Marginalization Revisted |- | 6 | 9/15/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture06-prob4.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture06-prob4.pptx PPTX] | --- | --- | Useful Distributions; Reasoning with Joint Distributions |- | 7 | 9/17/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture07-dgm.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture07-dgm.pptx PPTX] | --- | --- | Reasoning with Joint Distributions; Bayes Nets |- | 8 | 9/19/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture08-dgm2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture08-dgm2.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2013-CS401R/lectures/Lecture08-dgm2/Lecture08-dgm2.html All] | --- | Conditional Independence in Bayes Nets; Joint Queries of Bayes Nets |- | 9 | 9/22/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture09-answeringqueries.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture09-answeringqueries.pptx PPTX] | --- | --- | Answering Queries on Bayes Nets |- | 10 | 9/24/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture10-dgm3.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture10-dgm3.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2013-CS401R/lectures/Lecture09-dgm3/Lecture09-dgm3.html All] | [http://nlp.cs.byu.edu/~plf1/cs401rpml/Lecture10-example-supplement Example 1] [http://nlp.cs.byu.edu/~plf1/cs401rpml/Lecture10-example2-supplement Example 2] | Bayes Nets (cont.); Reading influence in Bayes Nets |- | 11 | 9/26/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture11-textclassification.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture11-textclassification.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2013-CS401R/lectures/Lecture11-textclassification/Lecture11-textclassification.html All] | --- | Intro. to Naive Bayes |- | 12 | 9/29/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture12-naivebayes2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture12-naivebayes2.pptx PPTX] | --- | --- | Alternative Event Models for Naive Bayes; Class-Conditional Language Models |- | 13 | 10/1/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture13-mle.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture13-mle.pptx PPTX] | --- | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture13-extra-lagrange.pdf PDF], [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture13-extra-lagrange.pptx PPTX] | Maximum Likelihood Estimation for the Categorical Distribution (and Naive Bayes) using Lagrange Multipliers |- | 14 | 10/3/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture14-dirichlet.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture14-dirichlet.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture14-dirichlet/Lecture14-dirichlet.html All] | --- | Expressing Uncertainty about Parameters; Beta and Dirichlet Distributions |- | 15 | 10/6/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture15-conjugacy.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture15-conjugacy.pptx PPTX] | --- | --- | Conjugate Priors: Beta-Binomial Conjugacy, Dirichlet-Multinomial Conjugacy; Bayesian Learning |- | 16 | 10/8/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture16-mapestimate.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture16-mapestimate.pptx PPTX] | --- | --- | Maximum a Posteriori Estimation for the Categorical Distribution (and for Naive Bayes) |- | 17 | 10/10/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture17-mixtureofmultinomials.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture17-mixtureofmultinomials.pptx PPTX] | --- | --- | Mixture Models; Mixture of Multinomials Model; Generative Stories |- | 18 | 10/13/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture18-textclustering-em.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture18-textclustering-em.pptx PPTX] | --- | --- | Text Clustering with Expectation Maximization |- | - | 10/15/2014 | --- | --- | --- | --- | Review for Mid-Term Exam |- | 19 | 10/20/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture19-initem.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture19-initem.pptx PPTX] | --- | --- | Initialization for Expectation Maximization; Glimpse of Hierarchical Bayesian Models |- | 20 | 10/22/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture20-gmm.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture20-gmm.pptx PPTX] | --- | --- | Gaussian Mixture Models |- | - | 10/24/2014 | --- | --- | --- | --- | Mid-Term Exam Follow-up |- | 21 | 10/27/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture21-gmm2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture21-gmm2.pptx PPTX] | --- | --- | Gaussian Mixture Models (cont.) |- | 22 | 10/29/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture22-seqlabeling.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture22-seqlabeling.pptx PPTX] | --- | --- | Sequence Labeling; Part of Speech Tagging; Hidden Markov Models |- | 23 | 10/31/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture23-viterbi.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture23-viterbi.pptx PPTX] | --- | --- | Hidden Markov Models; Viterbi Algorithm |- | 24 | 11/3/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture24-speechreco.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture24-speechreco.pptx PPTX] | --- | --- | Overview of Speech Recognition: Noisy Channel Model, DSP, Front End / Feature Extraction |- | 25 | 11/5/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture25-speechreco2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture25-speechreco2.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture25-speechreco2/Lecture25-speechreco2.html All] | --- | Overview of Speech Recognition: using Hidden Markov Models with Gaussian Mixture Models as Acoustic Models, Markov Chains as Language Models, Lexicon, Decoding |- | 26 | 11/7/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture26-gibbsintro.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture26-gibbsintro.pptx PPTX] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture26-gibbsintro/Lecture26-gibbsintro.html All] | --- | Monte Carlo Principle; Intro. to Gibbs Sampling |- | - | 11/10/2014 | --- | --- | --- | --- | Q&A |- | 27 | 11/12/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture27-gibbsclustering.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture27-gibbsclustering.pptx PPTX] | --- | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture27-gibbsclustering.avi Video] | Document Clustering with Gibbs Sampling on a Mixture of Multinomials |- | 28 | 11/14/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture28-gibbsclustering2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture28-gibbsclustering2.pptx PPTX] | --- | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture28-identifiabilitydiagnosis.avi Video] | Document Clustering with Gibbs Sampling: Metrics and Results |- | 29 | 11/17/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture29-lda.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture29-lda.pptx PPTX] | --- | --- | Introduction to Topic Modeling; Latent Dirichlet Allocation (LDA) |- | 30 | 11/19/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture30-gibbslda.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture30-gibbslda.pptx PPTX] | --- | --- | Latent Dirichlet Allocation: Inference with Gibbs Sampling |- | 31 | 11/21/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture31-gibbslda2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture31-gibbslda2.pptx PPTX] | --- | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture31-extra-gibbsconvergence.pdf PDF]; [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture31-extra-gibbsconvergence.pptx PPTX] | Latent Dirichlet Allocation: Inference with Gibbs Sampling (cont.) |- | 32 | 11/24/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture32-conditional.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture32-conditional.pptx PPTX] | --- | --- | Limitations of Joint Models; Motivating Conditional Models; Word Sense Disambiguation |- | 33 | 11/25/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture33-conditional2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture33-conditional2.pptx PPTX] | --- | --- | Features for Word Sense Disambiguation; Limitations of Joint Models; Motivating Conditional Models |- | 34 | 12/1/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture34-maxent.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture34-maxent.pptx PPTX] | --- | --- | Maximum Entropy Models |- | 35 | 12/3/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture35-maxent2.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture35-maxent2.pptx PPTX] | --- | --- | Maximum Entropy Models for Text Classification; Feature Engineering |- | 36 | 12/5/2014 | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture36-679preview.pdf PDF] | [http://faculty.cs.byu.edu/~ringger/Fall2014-CS401R/lectures/Lecture35-679preview.pptx PPTX] | --- | [http://www.cs.berkeley.edu/~tberg/slides/acl2013_slides_long.pdf Ocular Presentation] | Application of Course Ideas to Historical OCR; Preview of CS 679 (NLP) |- |} ---- BYU CS users also have full access to the posted lecture slides via the CS department file-system. Connect to schizo, and check the following directory: /users/home1/faculty/ringger/public_html/Fall2014-CS401R/lectures