Otty - Real time voice translation

OpenAI's Whisper for transcript and ChatCompletion for translation.

Features

• From a dropdown, select your spoken language and the language you want to translate to
• Speech to text transcription & Translation - Once you begin recording, Whisper and GPT3.5 will attempt to translate each word you speak in real-time
• Summarize - Once you are done recording, stop the recording and you will be able to summarize the transcription
• Voice - buggy. Once you are done speaking, stopping the recording session will give you an option for Voice. Which will read the translated text out via the TTS feature

AI Models

• Whisper Open Source Model
• GPT3.5-Turbo through Azure
• ElevenLabs - VoiceAI

Running locally

Setup Backend

Requirements:

• Python version 3.9+ - Download
• FFmpeg
  • Mac: brew install ffmpeg
  • Windows: follow this README

Setup:

• Follow the Backend README for further steps

Run the websocket server:

• run cd backend
• run python3 main.py

Setup Frontend

Requirements:

• Yarn
• Node (v16+)

Setup:

• run cd frontend
• run yarn install

Run the WebApp:

• run yarn start