Lecturer
Dr. Sandipan Sikdar
Junior-Professorinnen und Junior-Professoren
E-Mail
E-Mail
Course Content
- Neural networks
- Training and optimization
- Convolutional neural nets
- Recurrent neural networks
- Vanilla RNN
- LSTM
- GRU
- Sequence-to-sequence models
- Attention
- Transformers
- Language modeling
- Pretraining and Finetuning paradigm
- Language models
- ELMo, BERT, GPT
- Large language models
- Instruction finetuning
- Reinforcement learning with human feedback (RLHF)
- Retrieval augmented generation
- LLM Agents
Learning Goal
Learn about deep neural network architectures for text and learn to deploy them using PyTorch.
Teaching Assistents
TBA
Schedule and other information
Lecture: TBA
Exercise: TBA
ECTS: 5
Literature
Deep Learning, Ian Goodfellow, Yoshua Benjio and Aaron Courville
Speech and Language Processing, Dan Jurafsky and James H. Martin
Natural Language Processing with Deep Learning CS224N course at Stanford
