APM_5AI29_TP - Language Models and Structured Data

Beyond the traditional applications of Language Models in natural language processing-oriented tasks such as sentiment analysis, fake news detection, etc., the language models have been leveraged across a broad spectrum of other tasks involving structured data such as graphs, databases, tables, etc. This course is tailored to take into account the merits and demerits of employing language models and conventional approaches for tackling tasks related to structured data. Starting with an exploration of basic concepts in language modeling to large language models, low rank adaptation (LoRA), quantization,  prompt engineering and retrieval augmented generation, the curriculum progressively will move towards the interplay between language models and structured data. 

Topics covered:

1. Language Modeling and Prompt Engineering
2. Retrieval Augmented Generation
3. Language Models and Graphs
4. Language Models and Tabular Data & Databases
5. Text to Query Language
6. Code Generation