Natural Language Processing course at Johns Hopkins (601.465/665)
Dates | Module | Main Topics and Slides | Readings |
---|---|---|---|
8/29, 8/30, 9/4 | 1: Introduction | Introduction, Modeling Grammaticality, English Grammar; (CFG exercise) | J&M chapter 1, 5.1-5.2, 12.1-12.2 |
9/6, 9/9, 9/11 | 2: Language models | Probability basics, Language models, N-grams | J&M chapter 4.1-4.7 |
9/13, 9/16, 9/18, 9/20 | 3: Text classification | Log-Linear Models (interactive visualization), Machine Learning Experiment Setup; | Dan Klein’s tutorial |
9/23, 9/25, 9/27 | 4: Linguistics 101 | Short Introduction to Linguistics, Survey of the Languages of the World | J&M chapter 7.1-7.3, 12.3-12.7 |
9/30, 10/2, 10/4 | 5: Tree Parsing | Parsing: Constituency and Dependency trees, CKY algorithm, Eisner algorithm, Dynamic programming; (CKY exercise) | J&M chapter 13.1-13.4, 14.1-14.7 |
10/7, 10/9, 10/11 | 6: Neural Networks | MLP/RNN, Word Embeddings, Seq2Seq - Lecture by Arya McCarthy | |
10/14 | Research Talk | Guest Lecture by Pamela Shapiro: Word Embeddings for Morphologically-rich languages | |
10/16 | Midterm Exam | ||
10/21 | Research Talk | Guest Lecture by Zach Wood-Doughty: NLP for Social Media | |
10/23, 10/25, 10/28 | 7: Sequence Tagging | Hidden Markov Models, Viterbi algorithm, EM algorithm; Jason Eisner’s Excel practice: 1, 2 | J&M 3rd ed. chapter |
10/30* | Research Talk | Guest Lecture by Dingquan Wang: Synthetic Data made to order: the case for Dependency Parsing | |
11/1, 11/4 | 8: Topic Models | Probabilistic Latent Semantic Indexing, Latent Dirichlet Allocation, Topic Model Extensions (Polylingual, Dynamic, Author-recipient, Labelled, Gaussian) - Lecture by Suzanna Sia | Probabilistic Topic Models ACM Review |
11/8 | Research Talk | Guest Lecture by Tom Lippincott: NLP for Digital Humanities | |
11/6, 11/11, 11/13 | 9: Finite State Transducers | FSA, FST, Semirings, Finite-State Morphology | J&M chapter 2, 3.1-3.7 |
11/15, 11/18, 11/20 | 10: Semantics | Distributional Semantics, WordNet, Semantic Role Labeling | J&M chapter 19.1-19.4, 20.1-20.3, 20.9 |
11/22 | Research Talk | Guest Lecture by Sheng Zhang: Broad Coverage Semantic Parsing | |
12/2, 12/4 | 11: Structured Prediction | Global vs. Local models, Discriminative vs. Generative, CRF, Structured Perceptron/SVM | |
12/6 | Review |