📕 Table of Contents
MyGO is an LLM API that uses caching and KV-Database to improve response speed, similar to Gemini and Kimi.
In a typical AI workflow, you might pass the same input Tokens to the model over and over again. With the MyGO API's context caching feature, you can request text multiple times and only need to access the model once. By caching the input Tokens, calculating similarity using Cosine similarity, and referencing cached Tokens for subsequent requests, MyGO reduces costs and latency by avoiding the repeated processing of identical input data.
Check out Kimi for a practical example of how MyGO's concepts are applied.
Cosine similarity measures the similarity between two vectors by calculating the cosine of the angle between them. The cosine value ranges from -1 to 1, where:
- 1 indicates the vectors are identical in direction,
- 0 indicates the vectors are orthogonal (i.e., at 90°),
- -1 indicates the vectors are diametrically opposed.
This measure is widely used in positive space, where all values are non-negative, making it particularly useful for comparing textual data in natural language processing tasks.
To get started with MyGO, follow these steps:
- Install dependencies: Ensure you have Go installed on your machine.
- Clone the repository:
git clone https://github.com/Chihaya-Yuka/mygo.git cd mygo
- Run the service:
go run main.go
For more detailed instructions, see the Documentation section.
If you want to build MyGO from source, follow these steps:
- Clone the repository:
git clone https://github.com/Chihaya-Yuka/mygo.git cd mygo
- Build the project:
go build -o mygo main.go
- Run the binary:
./mygo
This will start the MyGO service on your local machine.
To launch the MyGO service from the source, simply run:
go run main.go
This will start the service, which you can then interact with via HTTP requests.
For more detailed documentation, including API references and advanced configuration options, visit the MyGO Documentation.
Join our community to share your experiences, ask questions, and collaborate with others:
We welcome contributions! If you'd like to contribute to MyGO, please:
- Fork the repository.
- Create a new branch (
git checkout -b feature-branch
). - Make your changes and commit them (
git commit -m 'Add new feature'
). - Push to the branch (
git push origin feature-branch
). - Open a pull request.