-
Notifications
You must be signed in to change notification settings - Fork 4.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(llm): check multi modal input with provider and fix cost calculation #13445
Conversation
03e9182
to
9785808
Compare
needs tests |
9785808
to
83ec366
Compare
local content | ||
if type(v.content) == "table" then | ||
content = v.content | ||
else |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not a blocker. Are we going to keep compatible to the old format?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
both formats are not deprecated, but right not only openai and bedrock supports the multi-modal format as well as the non multi-modal formats ("old format")
Successfully created cherry-pick PR for |
Summary
For multi modal inputs (openai or bedrock), the input format is changed from:
to
Checklist
changelog/unreleased/kong
orskip-changelog
label added on PR if changelog is unnecessary. README.mdIssue reference
AG-61