Skip to content

LLM Zoomcamp - a free online course about building a Q&A system

Notifications You must be signed in to change notification settings

DataTalksClub/llm-zoomcamp

Repository files navigation

LLM Zoomcamp

LLM Zoomcamp - a free online course about real-life applications of LLMs. In 10 weeks you will learn how to build an AI system that answers questions about your knowledge base.

2024 cohort

Pre-requisites

  • Comfortable with programming and Python
  • Comfortable with command line
  • Docker
  • No previous exposure to AI or ML is required

Syllabus

We encourage Learning in Public

Pre-course workshops

Implement a search engine: Video, code

  • LLMs and RAG
  • Preparing the environment
  • Retrieval and the basics of search
  • OpenAI API
  • Simple RAG with Open AI
  • Text search with Elasticsearch
  • Getting an environment with a GPU
  • Open-source models from HuggingFace Hub
  • Running LLMs on a CPU with Ollama
  • Creating a simple UI with Streamlit
  • Vector search
  • Creating and indexing embeddings
  • Vector search with Elasticsearch
  • Offline evaluation of retrieval
  • Offline evaluation of RAG
  • Cosine and LLM-as-a-Judge metrics
  • Tracking chat history and user feedback
  • Creating dashboards with Grafana for visualization
  • Ingesting data with Mage
  • Best practices

LLM Zoomcamp 2024 Competition

More details

Instructors

Asking questions

The best way to get support is to use DataTalks.Club's Slack. Join the #course-llm-zoomcamp.

To make discussions in Slack more organized:

Supporters and partners

Thanks to the course sponsors for making it possible to run this course

Do you want to support our course and our community? Please reach out to alexey@datatalks.club