RAG Systems Online Course

RAG Systems Online Course

This course guides you through mastering Retrieval-Augmented Generation (RAG) systems, starting with the fundamentals and environment setup. You’ll learn the basics of naive RAG, its limitations, and then advance to techniques like expanding answers, embedding text chunks, and similarity searches. Through hands-on practice, you’ll work with vector stores, generate answers, and visualize embeddings. The course also covers advanced methods such as query expansion, re-ranking with cross-encoders, and dense passage retrieval. By the end, you’ll have the skills to design and implement sophisticated RAG solutions for real-world applications.

Who should take this course?

This course is designed for AI engineers, data scientists, machine learning practitioners, and developers who want to build advanced Retrieval-Augmented Generation (RAG) systems. It’s also valuable for researchers, solution architects, and professionals working with large language models who aim to enhance accuracy, scalability, and efficiency in real-world AI applications.

What you will learn

• Implement naive and advanced RAG techniques
• Optimize document retrieval and answer generation
• Apply query expansion with multiple queries
• Utilize cross-encoder and bi-encoder re-ranking
• Perform dense passage retrieval effectively
• Integrate advanced RAG techniques into AI applications

Course Outline

Introduction

• Introduction
• Course Structure
• Development Environment Setup

RAG (Retrieval-Augmented Generation) Deep Dive - Naive RAG vs Advanced RAG

• Introduction to RAG and the RAG Triad - Overview
• What is RAG and Naive RAG Overview and Pitfalls
• Deep Dive into Each Naive RAG Drawbacks

Advanced RAG Deep Dive - Advanced Techniques

• Advanced RAG Techniques - Intro to Expansion with Generated Answers
• Hands-on - Expansion with Answers - Splitting Text
• Embedding the Chunks and Showing Them
• Adding Documents to the Vector Store and Performing Similarity Search
• Generating the Answer and Concatenating the Relevant Documents
• Plotting and Projecting the Embedded Results on Graph
• Query Expansion with Generated Answers - Summary

Hands-on: Advanced RAG Technique - Query Expansion with Multiple Queries

• Query Expansion with Multiple Queries - Overview
• Getting Generated Augmented Queries
• Retrieving and Plotting Embeddings in a 2D Graph
• CHALLENGE: Your Turn
• Expansion with Multiple Queries Downsides and Summary

Hands-on - Advanced RAG Technique: Re-Ranking with Cross-encoder

• Re-ranking and Cross-encoder and Bi-encoders - Overview
• Ranking Long-tail Results with Cross-encoder
• Final Step - Pass the Ranked Documents through a LLM to Get Relevant Answer
• Re-ranking Summary

Hands-on - Advanced RAG Technique: Dense Passage Retrieval (DPR)

• Dense Passage Retrieval Overview
• The DPR Technique - Full Hands-on
• DPR Summary

Other Advanced RAG Techniques

• Other Techniques

Wrap up - What's Next

• What's Next