groqchat

A terminal chatbot, powered by Groq Cloud API (Windows / macOS / Linux / Android / iOS)

Modified groq chatbot developed in https://github.com/eliranwong/freegenius

A simple chatbot that runs fast on mobile phones as well as pc.

Groq API Key

Get a Groq API key first. Read https://github.com/eliranwong/freegenius/wiki/Set-up-a-Groq-Cloud-API-Key

Android / iOS / iPhone / iPad Users

iOS/iPad/iPhone: Use iSH on iOS/iPad/iPhone.

Android: Use Termux on Android.

Installation

With python installed, setup gropchat via pip:

pip install groqchat

Or

pip install gchat

Android Users

1. Install rust

pkg install rust

2. Use "--system-site-packages" if you create a virtual environment, e.g.

python -m venv gchat --system-site-packages

source gchat/bin/activate

pip install --upgrade gchat

On Android, use Android built-in voice typing keyboards of Ctrl+S.

Install Termux:API, to work with response output on Andoird.

Get Started

Simply run 'gchat':

gchat

Enter your Groq cloud a single API key or a list of multiple API keys:
(Remarks: If a list of multiple API keys are entered, entered API keys are automatically rotated for running inference.)

Select a model:

Special Entries

Enter a dot '.' to display available special entries:

'.new' - start a new chart session

'.api' - change api key

'.model' - change model

'.systemmessage' - change system message

'.temperature' - change temperature

'.maxtokens' - change max tokens

'.togglewordwrap' - toggle word wrap

'.togglevoiceoutput' - toggle voice output

'.exit' - exit the application

Keyboard Shortcuts

By default:

Ctrl+Z - cancel

Ctrl+Q - exit / quit

Ctrl+I / TAB - insert new line

Ctrl+N - new chat session

Ctrl+W - toggle word wrap

Ctrl+Y - toggle voice output

Ctrl+S - trigger voice typing

Configurations

Advanced users may change configurations manually by editing the file "config.py" located in the package folder.

Remarks: Close the app before editing the file.

CLI Options

Run 'gchat --help' for cli options

gchat --help

For example, to start with a greeting:

gchat "Hi!"

For example, to set temperature to 0.8 and maximum output tokens to 1024, run:

gchat -t 0.8 -o 1024 "Hi!"

Install Multiple Copies

You may want to install multiple copies to customise them with different system messages or other settings.

An easy way to achieve it is to use alias, e.g.:

mkdir apps

cd apps

python3 -m venv assist explain quote illustrate summarize

source assist/bin/activate

pip install gchat

source explain/bin/activate

pip install gchat

source quote/bin/activate

pip install gchat

source illustrate/bin/activate

pip install gchat

source summarize/bin/activate

pip install gchat

nano .bashrc

Add the following aliases:

alias explain=$HOME/apps/explain/bin/gchat
alias illustrate=$HOME/apps/illustrate/bin/gchat
alias quote=$HOME/apps/quote/bin/gchat
alias assist=$HOME/apps/assist/bin/gchat
alias summarize=$HOME/apps/summarize/bin/gchat