|
TOPICS IN NATURAL LANGUAGE PROCESSING
|
Lecturer: Shay Cohen
Time and Location: Tuesday and Friday, 13:10-14:00, Room 1.01, 14 Buccleuch Place (semester 2)
Office Hours: Tuesday, 14:30-15:30. Could also set an appointment.
SCHEDULE
Part I: Lectures
| Week | No. | Date | Topic | Slides | Reading |
|---|
| 1 |
1 |
13/1/15 |
Introduction |
slides |
History of NLP (Karen Sparck Jones) |
| 1 |
2 |
16/1/15 |
Statistical Learning Paradigms in NLP |
slides |
Probability for linguists (John Goldsmith) |
| 2 |
3 |
20/1/15 |
Statistical Learning Paradigms in NLP |
slides |
Bayesian inference with tears (Kevin Knight) |
| 2 |
4 |
23/1/15 |
Structure in NLP |
slides |
Linguistic Structure Prediction, Smith (2011), Chapter 1 |
| 3 |
5 |
27/1/15 |
Probabilistic Grammar Formalisms |
slides |
PCFGs (Michael Collins) |
| 3 |
6 |
30/1/15 |
Inference in NLP |
slides |
Linguistic Structure Prediction, Smith (2011), Chapter 2. See also readings from last class. |
| 4 |
7 |
3/2/15 |
Learning Algorithms |
slides |
Log-linear models (Michael Collins), Log-linear models (Noah Smith) |
| 4 |
8 |
6/2/15 |
Learning from Incomplete Data |
slides |
Linguistic Structure Prediction, Smith (2011), Chapter 3 |
| 5 |
9 |
10/2/15 |
Evaluation and Experimental Design |
slides |
Linguistic Structure Prediction, Smith (2011), Appendix B; What's in a p-value in NLP? (Sogaard et al.); Semi-supervised Learning Literature Survey, Jerry Zhu |
| 5 |
10 |
13/2/15 |
Summary |
Quiz, see email |
All of the above |
| Innovative Learning Week (16/2/2015 - 20/2/2015) - no classes |
Part II: Student presentations
24/2:
- Alessandra Cervone: Minimally Supervised Event Causality Identification, EMNLP (2011). [slides] [Mateusz Dubiel, Vinay Krupakaran]
- Vinay Krupakaran: Automatic Identification of General and Specific Sentences by Leveraging Discourse Annotations, IJCAI (2011). [slides] [Alessandra Cervone, Mateusz Dubiel]
27/2:
- Mateusz Zan: Better Word Representations with Recursive Neural Networks for Morphology, CoNLL (2013). [slides] [Daniel Wells, Anna Donohoe]
- Aristeidis Tsialos: Abstract Meaning Representation for Sembanking, LAWID (2013). [slides] [Toms Bergmanis, Craig Wilkinson]
3/3:
- Angus Scott: Probabilistic Topic Models (2007). [slides] [Eilidh Hendry, Rong Zhou]
- Tanvi Dinkar: Unsupervised Word Sense Disambiguation Rivaling Supervised Methods, ACL (1995). [slides] [Qiuyu Li, Nora Hollenstein]
6/3:
- Nora Hollenstein: Combining Distributional and Morphological Information for Part of Speech Induction, EACL (2013). [slides] [Sarah Bennett, Lu Guannan]
- Ryan Davies: Natural Language Processing (Almost) from Scratch, ICML (2011) [slides] [Tanvi Dinkar, Marco Damonte]
10/3:
- Jake Vasilakes: A Generative Model for Parsing Natural Language to Meaning Representations, EMNLP (2008). [slides] [Ziwei Peng, Mateusz Zan]
- Ziwei Peng: Not an Interlingua, but Close: Comparison of English AMRs to Chinese and Czech, LREC (2014). [slides] [Jake Vasilakes, Daniel Vollmer]
13/3:
- Eilidh Hendry: Reading Tea Leaves: How Humans Interpret Topic Models, NIPS (2009). [slides] [Angus Scott, Aristeidis Tsialos]
- Marco Damonte: Learning Continuous Phrase Representations and Syntactic Parsing with Recursive Neural Networks, NIPS (2010). [slides] [Qiyu Li, Mateusz Zan]
17/3:
- Sarah Bennett: Predicting Elections with Twitter: What 140 Characters Reveal about Political Sentiment, ICWSM (2010). [slides] [Nora Hollenstein, Eilidh Hendry]
- Lu Guannan: Word Embeddings: A Simple and General Method for Semi-supervised Learning, ACL (2010). [slides] [Toms Bergmanis, Daniel Vollmer]
20/3:
- Rong Zhou: KenLM: Faster and Smaller Language Model Queries, WSMT (2011). [slides] [Alexander Clarke, Ryan Davies]
- Craig Wilkinson: Parsing Natural Scenes and Natural Language with Recursive Neural Networks, ICML (2011). [slides] [Ryan Davies, Aristeidis Tsialos]
24/3:
- Qiuyu Li: Random walks for knowledge-based word sense disambiguation, CL (2014). [slides] [Tanvi Dinkar, Angus Scott]
- Alexander Clarke: Recurrent Neural Network Based Language Model, INTERSPEECH (2010). [slides] [Qian Zhong, Ziwei Peng]
- Toms Bergmanis: Exploiting similarities among languages for machine translation, arXiv. [slides] [Craig Wilkinson, Marco Damonte]
27/3:
- Daniel Wells: Finite-state morphology (selected information from the book by Sproat and Roark). [slides] [Anna Donohoe, Alexander Clarke]
- Daniel Vollmer: From Single to Multi-document Summarization: A Prototype System and its Evaluation, ACL (2014). [slides] [Sarah Bennet, Qian Zhong]
31/3:
- Mateusz Dubiel: One vector is not enough: Entity-augmented distributional semantics for discourse relations (2014). [slides] [Alessandra Cervone, Vinay Krupakaran]
- Anna Donohoe: Dependency Parsing of Turkish, CL (2008). [slides] [Daniel Wells, Jake Vasilakes, Qian Zhong]
- Qian Zhong: Non-projective Dependency Parsing using Spanning Tree Algorithms, EMNLP (2005). [slides] [Rong Zhou, Lu Guannan]
Each student will have 15-20 minutes for their presentation, with a few additional minutes for questions and discussion.
Back to main page.
