NLP

Natural Language Processing course at Johns Hopkins (601.465/665)

Lectures

Dates Module Main Topics and Slides Readings
8/29, 8/30, 9/4 1: Introduction Introduction, Modeling Grammaticality, English Grammar; (CFG exercise) J&M chapter 1, 5.1-5.2, 12.1-12.2
9/6, 9/9, 9/11 2: Language models Probability basics, Language models, N-grams J&M chapter 4.1-4.7
9/13, 9/16, 9/18, 9/20 3: Text classification Log-Linear Models (interactive visualization), Machine Learning Experiment Setup; Dan Klein’s tutorial
9/23, 9/25, 9/27 4: Linguistics 101 Short Introduction to Linguistics, Survey of the Languages of the World J&M chapter 7.1-7.3, 12.3-12.7
9/30, 10/2, 10/4 5: Tree Parsing Parsing: Constituency and Dependency trees, CKY algorithm, Eisner algorithm, Dynamic programming; (CKY exercise) J&M chapter 13.1-13.4, 14.1-14.7
10/7, 10/9, 10/11 6: Neural Networks MLP/RNN, Word Embeddings, Seq2Seq - Lecture by Arya McCarthy  
10/14 Research Talk Guest Lecture by Pamela Shapiro: Word Embeddings for Morphologically-rich languages  
10/16 Midterm Exam    
10/21 Research Talk Guest Lecture by Zach Wood-Doughty: NLP for Social Media  
10/23, 10/25, 10/28 7: Sequence Tagging Hidden Markov Models, Viterbi algorithm, EM algorithm; Jason Eisner’s Excel practice: 1, 2 J&M 3rd ed. chapter
10/30* Research Talk Guest Lecture by Dingquan Wang: Synthetic Data made to order: the case for Dependency Parsing  
11/1, 11/4 8: Topic Models Probabilistic Latent Semantic Indexing, Latent Dirichlet Allocation, Topic Model Extensions (Polylingual, Dynamic, Author-recipient, Labelled, Gaussian) - Lecture by Suzanna Sia Probabilistic Topic Models ACM Review
11/8 Research Talk Guest Lecture by Tom Lippincott: NLP for Digital Humanities  
11/6, 11/11, 11/13 9: Finite State Transducers FSA, FST, Semirings, Finite-State Morphology J&M chapter 2, 3.1-3.7
11/15, 11/18, 11/20 10: Semantics Distributional Semantics, WordNet, Semantic Role Labeling J&M chapter 19.1-19.4, 20.1-20.3, 20.9
11/22 Research Talk Guest Lecture by Sheng Zhang: Broad Coverage Semantic Parsing  
12/2, 12/4 11: Structured Prediction Global vs. Local models, Discriminative vs. Generative, CRF, Structured Perceptron/SVM  
12/6 Review