CS 288. Advanced Natural Language Processing
Catalog Description: This course provides a graduate-level introduction to Natural Language Processing (NLP). We will survey foundational approaches such as word representations and n-gram language models, followed by neural methods including recurrent networks and attention mechanisms, and then progress to modern Transformer-based architectures. In addition, the course will cover advanced topics in contemporary NLP, including retrieval-augmented models, mixture-of-experts architectures, AI agents, and memorization.
Units: 4
Course Objectives:
Learn foundational concepts in NLP, such as word representations, recurrence, attention, and n-gram language models.
Learn concepts related to modern language models, including Transformers, pre-training, post-training, fine-tuning, reasoning models, and evaluation.
Learn contemporary NLP topics, including retrieval-augmented models, mixture-of-experts, AI agents, and memorization.
Prerequisites: CS 288 assumes prior experience in machine learning and strong programming proficiency in PyTorch. Previous coursework in linguistics or natural language processing (e.g., EECS 183/283A, an undergraduate-level NLP course) is recommended but not required.
Grading Basis: Default Letter Grade; P/NP Option
Final Exam Status: No
Class Schedule (Spring 2027):
CS 288 – TuTh 11:00-12:29, The Gateway Building 1220 –
Sewon Min
Class Notes
- Course website: cal-cs288.github.io/sp27
(Students who cannot directly enroll can follow instructions on the website.)
- Time conflicts are allowed
- No alternate final
- Class will be recorded
- Seats reserved for students with enrollment permission are not available upon request. They are reserved for students in internal programs.
Links: