Streaming Tool Calls not supported in ChatVertexAI, ChatGoogleGenerativeAI and ChatGroq #6099
Open
5 tasks done
Labels
auto:bug
Related to a bug, vulnerability, unexpected error with an existing feature
Checked other resources
Example Code
When ever we pass any tools to model except ChatOpenAI, the streaming functionality does not work.
The model are being invoked here, but the langgraph agent is being streamed. OpenAI works as I expect , giving me
on_llm_stream
event. But when ever other model are used onlyon_llm_start
andon_llm_end
event are fired.Also while I am at this ,
ChatVertexAI
does not have any option to passstreaming
/stream
when I initiate it.Error Message and Stack Trace (if applicable)
No response
Description
I am trying to build a LLM app with multiple model support. ChatOpenAI works well for good user experience with streaming but other provider (mainly ChatVertexAI, ChatGoogleGenerativeAI and ChatGroq) do not stream data.
System Info
pnpm version 9.4
windows 10
The text was updated successfully, but these errors were encountered: