Tool-use with BedrockChat llama3.1

[thedan158]

Checked

• I searched existing ideas and did not find a similar one
• I added a very descriptive title
• I've clearly described the feature request and motivation for it

Feature request

im trying to use BedrockChat with createToolCallingAgent but it return throw new Error("Currently, tool calling through Bedrock is only supported for Anthropic models.");
seem like if model name doesnt have anthropic in it , it will throw the error

as i research meta llama3.1 has been added to Bedrock Models List with Tool use enabled

as far as i understand BedrockChat can do toolcalling with model having tool use === YES in the model list image
and ChatBedrockConverse can do tool calling with model having streaming tool use YES ?

Motivation

Motivation is just to make Bedrock intergration better in langchainjs

Proposal (If applicable)

No response

[tejasAMGI]

As of 08/15/2024, Bedrock has not fully integrated tool calling with llama3.1. As mentioned here, toolConfig parameter is supported by only a few models. Hopefully, Bedrock will release it in the future.

But in the meantime, you can use Ollama to host llama3.1 and use tool calling flawlessly.