Weekly Schedule
(latest change: 2020-01-14)
- Dan Jurafsky & James H. Martin, Speech and Language Processing, 3rd edition (draft available online. Rerences to this are written as
JM-3.i.kin the Schedule, withibeing the chapter. - Jacob Eisenstein, Introduction to Natural Language Processing, MIT Press (draft available online). Referred to as
E.i.j, whereiis the chapter number (andj, if present, the subsection number). - Yoav Goldberg, Neural Network Methods for Natural Language Processing, Morgan & Claypoole, 2017;
G-nis chaptern. (If you are on the UP network, you can download this from here.)
The slides will be here, after class.
| Week | Date | Theme | Focus | Readings | Assignment |
|---|---|---|---|---|---|
| 1 | 2019-10-16 | Intro | E.1 | ||
| 2019-10-17 | Probability | https://mml-book.github.io ; Goldw. Tut | |||
| 2 | 2019-10-23 | Words, Representations | words, relations | JM-3.6 | A1 released |
| 2019-10-24 | words, embeddings | JM-3.6, E.3.3.4, E.14.5-6 | |||
| 3 | 2019-10-30 | Sequences I | n-grams | JM-3.3 | |
| 2019-10-31 | / | / | / | ||
| 4 | 2019-11-06 | Tools / Framings: Classification | binary classification | E.2.0-5, E.4.2-4.4.1, JM-3.4, JM-3.5.0-6 | A1 due; A2 released |
| 2019-11-07 | multiclass classification | E.4.2, JM-3.5.6 | |||
| 5 | 2019-11-13 | discussion of A1 | |||
| 2019-11-14 | Sequences II | HMMs, POS-Tagging | E.7.0-4, JM-3.8 | ||
| 6 | 2019-11-20 | HMM, part II | A2 due; A3 released | ||
| 2019-11-21 | CRFs | E.7.5, E.8.3 | |||
| 7 | 2019-11-27 | discussion of A2 | |||
| 2019-11-28 | Tools / Framings: NNs | NNs I: FF | E.3.0-3, G.1-4 | ||
| 8 | 2019-12-04 | NNs II: RNNs | G.10-11 | A3 due; A4 released | |
| 2019-12-05 | NNs III: LSTMs, Pre-Training | ||||
| 9 | 2019-12-11 | discussion of A3 | |||
| 2019-12-12 | cancelled, ill | ||||
| 10 | 2019-12-18 | Structure | CFGs, CKY | E.10.0-5, JM-3.12 | A4 due |
| 2019-12-19 | discussion of A4 | ||||
| 2019-12-25 | no class (holiday) | ||||
| 2019-12-26 | no class (holiday) | ||||
| 2020-01-01 | no class (holiday) | ||||
| 2020-01-02 | no class (holiday) | ||||
| 11 | 2020-01-08 | pyTorch practical | TBA | A5 released | |
| 2020-01-09 | pyTorch practical | TBA | |||
| 12 | 2020-01-15 | PCFGs | E.11, JM-3.13 | ||
| 2020-01-16 | Dependency parsing I | ||||
| 13 | 2020-01-22 | Semantics | Semantics I | E.12 | A5 due; A6 released |
| 2020-01-23 | discussion of A5 | ||||
| 14 | 2020-01-29 | Semantics II, Seq2Seq | |||
| 2020-01-30 | Seq2Seq II: Attentn & Pointers | ||||
| 15 | 2020-02-05 | The Real World | Ethics of doing NLP | TBA | |
| 2020-02-06 | final projects |
The slides build (sometimes significantly) on material from other courses:
- CS388 given by Greg Durrett at U Texas, Austin.
- earlier editions of this class (ANLP), as given by Alexander Koller and Tatjana Scheffler
which I am very grateful to acknowledge.