[BUG]: Configuration to Enable/Disable LLM Streaming #1807
Labels
bug
Something isn't working
core-team-only
investigating
Core team or maintainer will or is currently looking into this issue
What would you like to see?
I have an issue using AnythingLLM with our companies AzureOpenAI endpoint. When trying to start a chat the docker container is crashing and shutting down. In the log I can see the following error.
undefined
2024-07-03 16:20:18 /app/server/endpoints/chat.js:117
2024-07-03 16:20:18 error: e.message,
2024-07-03 16:20:18 ^
2024-07-03 16:20:18
2024-07-03 16:20:18 TypeError: Cannot read properties of undefined (reading 'message')
2024-07-03 16:20:18 at /app/server/endpoints/chat.js:117:20
2024-07-03 16:20:18 at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Not sure what exactly is the reason for it. But I got to notice that my company disabled "streaming" on the endpoint and something is telling me, that it migh be related to that.
I am wondering if there is a possibility to prevent anythingLLM from using the streaming approach.
The text was updated successfully, but these errors were encountered: