Welcome to: Building AI Applications with Open-Source Models

Videos explaining how everything works can be found in the course on gumroad.

Local Setup

• Ensure you have Python >3.11,<3.12 installed. Do not use Python 3.12 as some dependencies do not support it yet.
• Ensure you have git installed
• (Optional but recommended): Create a virtual environment
• Run pip install -r requirements.txt

Part 2 Setup

• Download a small model appropriate for your system from here: https://huggingface.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-GGUF
• Ensure you download the file as a .gguf file (see course for details)
• Save the file to the data directory and name it: tinyllama.guff
• Download the larger model