You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Perhaps the outlines version should be updated
In vllm, in requirements-common.txt it is specified outlines == 0.0.34.
Using outlines==0.0.41 in the example script above, I get valid jsons with date field.
Your current environment
I host llama3-8B-instruct model
in a docker image using the base image vllm/vllm-openai:0.4.1
openai version: 1.6.1 (example script below)
🐛 Describe the bug
description
When we prompt the model to produce a json with the guided_json parameter set and including a date field, we get an invalid json response.
This is also not dependent on the specific model. We got the same error with mixtral models.
code
result
{ "DocumentDate": 1999-01-01 }
expected result
{ "DocumentDate": "1999-01-01" }
The text was updated successfully, but these errors were encountered: