This is a Christian Apologetic chatbot prototype.
It runs fully on CPU.
It's built from following components:
- Streamlit interface
- llama-cpp-python for LLM inference
- Jina's vectorizer and reranker with HuggingFace's Sentence Transformers
- Weaviate and it's free sandbox (you can also run it locally)
You can download the models following way
huggingface-cli download microsoft/Phi-3-mini-4k-instruct-gguf Phi-3-mini-4k-instruct-q4.gguf --local-dir . --local-dir-use-symlinks False