We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
We should add a tokio::select! right at https://github.com/firstbatchxyz/dkn-compute-node/blob/master/src/compute/ollama.rs#L117 so that if the process is terminated while a search is going on, it should cancel that call and return gracefully.
tokio::select!
If Ollama is running on container & is killed anyways, it will terminate with code 500, but we could be more graceful this way.
Our Ollama wrapper should take the token in the struct itself, and this token should be used in setup as well.
setup
The text was updated successfully, but these errors were encountered:
Successfully merging a pull request may close this issue.
We should add a
tokio::select!right at https://github.com/firstbatchxyz/dkn-compute-node/blob/master/src/compute/ollama.rs#L117 so that if the process is terminated while a search is going on, it should cancel that call and return gracefully.If Ollama is running on container & is killed anyways, it will terminate with code 500, but we could be more graceful this way.
Our Ollama wrapper should take the token in the struct itself, and this token should be used in
setupas well.The text was updated successfully, but these errors were encountered: