andrewgcodes / FalconStreaming Public

Notifications You must be signed in to change notification settings
Fork 7
Star 39

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search

39 stars 7 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
Falcon40B_Instruct_Streaming.ipynb		Falcon40B_Instruct_Streaming.ipynb
Falcon7B_Instruct_Streaming.ipynb		Falcon7B_Instruct_Streaming.ipynb
README.md		README.md

Repository files navigation

FalconStreaming

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search 4bit

You must change the runtime type for Colab to run both 7B and 40B!

Screen Shot 2023-06-06 at 2 02 18 PM

Adapted from Serin32's starter code on huggingface: https://huggingface.co/tiiuae/falcon-40b/discussions/38

About

Falcon40B and 7B (Instruct) with streaming, top-k, and beam search

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%