Skip to content

v0.0.3-rc.2

Pre-release
Pre-release
Compare
Choose a tag to compare
@github-actions github-actions released this 16 Apr 21:51
· 39 commits to f54d8ae9c0c439ba695242bd0bd9b73ffba5a027 since this release
b066eb0

Final major improvements to streaming chat workflow. Fixed issues with Cohere streaming chat.
Expanded and revisited Cohere params in config.

Added

  • 🔧 #195 #196: Set router ctx in stream chunks & handle end of stream in case of some errors (@roma-glushko)
  • 🐛🔧 #197: Handle max_tokens & content_filtered finish reasons across OpenAI, Azure and Cohere (@roma-glushko)

Changed

  • 🔧 💥 #198: Expose more Cohere params & fixing validation of provider params in config (breaking change) (@roma-glushko)
  • 🔧 #186: Rendering Durations in a human-friendly way (@roma-glushko)

Fixed

  • 🐛 #209: Embed Swagger specs into binary to fix panics caused by missing swagger.yaml file (@roma-glushko)
  • 🐛 #200: Implemented a custom json per line stream reader to read Cohere chat streams correctly (@roma-glushko)