Article Source
Natural Language Processing with Deep Learning
Schedule and Syllabus
Event  Date  Description  Course Materials  

Lecture  Jan 10  Introduction to NLP and Deep Learning 
Suggested Readings:
[slides] [Lecture Notes 1] 

Lecture  Jan 12  Word Vector Representations: word2vec 
Suggested Readings:
Spotlight: [slides] [paper] 

A1 released  Jan 12  Assignment #1 released  [Assignment 1][Written solution]  
Lecture  Jan 17  Advanced Word Vector Representations 
Suggested Readings:
[Lecture Notes 2] Spotlight: [slides] [paper] 

Lecture  Jan 19  Word Window Classification and Neural Networks 
Suggested Readings:
[Lecture Notes 3] 

Lecture  Jan 24  Backpropagation and Project Advice 
Suggested Readings:
Spotlight: [slides] [paper] 

Lecture  Jan 26  Dependency Parsing 
Suggested Readings:
[Lecture Notes 4] Spotlight: [slides] [paper] 

A1 Due  Jan 26  Assignment #1 due  
A2 Released  Jan 26  Assignment #2 released  [Assignment 2][Written solution]  
Lecture  Jan 31  Introduction to TensorFlow 
Suggested Readings:
[slides] [Lecture Notes Tensorflow] Spotlight: [slides] [paper] 

Lecture  Feb 2  Recurrent Neural Networks and Language Models 
[slides] [vanishing grad example] [vanishing grad notebook] Spotlight: [slides] [paper] 

Lecture  Feb 7  Machine translation and advanced recurrent LSTMs and GRUs 
[slides] [Lecture Notes 5] Spotlight: [slides] [paper 1] [paper 2] [paper 3] 

Review  Feb 9  Midterm Review  [slides]  
Project Proposal Due  Feb 9  Final project proposal due  [Project page]  
A2 Due  Feb 9  Assignment #2 due  
A3 Released  Feb 13  Assignment #3 released  [Assignment 3][Written solution]  
Midterm  Feb 14  Inclass midterm 
[Gradient Computation Notes] Practice midterms: [Midterm 1] [Midterm 2] [Midterm 1 Solutions] [Midterm 2 Solutions] 

Lecture  Feb 16  Neural Machine Translation and Models with Attention 
Suggested Readings:
Spotlight: [slides] [paper] 

Lecture  Feb 21  Gated recurrent units and further topics in NMT 
Suggested Readings:
[Lecture Notes 6] Spotlight: [slides] [paper] 

Lecture  Feb 23  Endtoend models for Speech Processing 
[slides] 

A3 Due  Feb 25  Assignment #3 due  
A4 Released  Feb 25  Assignment #4 released  Default final project [Assignment 4]  
Lecture  Feb 28  Convolutional Neural Networks 
Suggested Readings:
Spotlight: [slides] [paper] 

Lecture  Mar 2  Tree Recursive Neural Networks and Constituency Parsing 
Suggested Readings:
[Lecture Notes 7] Spotlight: [slides] [paper] 

Lecture  Mar 7  Coreference Resolution 
Suggested Readings:


Lecture  Mar 9  Dynamic Neural Networks for Question Answering 
[slides] [Lecture Notes 8] Spotlight: [slides] [paper] 

Lecture  Mar 14  Issues in NLP and Possible Architectures for NLP 
[slides] Spotlight: [slides] [paper] 

Lecture  Mar 16  Tackling the Limits of Deep Learning for NLP 
[slides] Spotlight: [slides] [paper 1] [paper 2] 

Final Project Due  Mar 17  Final course project / Assignment #4 due  
Poster Presentation  Mar 21  Final project poster presentations  12:153:15, Lathrop Library Second Floor [Piazza Post on Logistics] [Facebook Event] 