Skip to content

Build a Llama 2 chatbot in Python using the Streamlit framework for the frontend, while the LLM backend is handled through API calls to the Llama 2 model hosted on Replicate.

Notifications You must be signed in to change notification settings

sridharaiyer/llama2-chat

Repository files navigation

🦙💬 Llama 2 Chat

This chatbot is created using the open-source Llama 2 LLM model from Meta.

Particularly, we're using the Llama2-7B model deployed by the Andreessen Horowitz (a16z) team and hosted on the Replicate platform.

This app was refactored from a16z's implementation of their LLaMA2 Chatbot to be light-weight for deployment to the Streamlit Community Cloud.

Demo App

Streamlit App

Prerequisite libraries

streamlit
replicate

Getting your own Replicate API token

To use this app, you'll need to get your own Replicate API token.

After signing up to Replicate, you can access your API token from this page.

Other Llama 2 models to try

As mentioned above, this chatbot implementation uses the Llama2-7B model that was trained on 7 billion parameters.

You can also try out the larger models:

Further Reading

About

Build a Llama 2 chatbot in Python using the Streamlit framework for the frontend, while the LLM backend is handled through API calls to the Llama 2 model hosted on Replicate.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published