Support recursive arrays in JSON when an item is an array

[AL-377]

I have noticed that the origin outlines doesn't support recursive array type. To be clear, here is a example：

from outlines.text.json_schema import build_regex_from_schema
from pydantic import BaseModel
from typing import List
import json 

class ItemModel(BaseModel):
    name:str

class ArrayModel(BaseModel):
    items:List[List[ItemModel]]

test_json = \
{
    "items": [[{"name":"item1"},{"name":"item2"}]], 
}


json_schema = ArrayModel.model_json_schema()
print(json.dumps(json_schema,indent=2))

regex = build_regex_from_schema(json.dumps(json_schema))
print(regex)

parsed = ArrayModel.model_validate_json(json.dumps(test_json))
print(parsed)

Run the code above, then we can get the json schema of ArrayModel , but we will get a error from build_regex_from_schema when we meet the List[List[]] type property.

And now, I have modified the code in outlines and it works. You can check the test_json_schema.py

[AL-377]

It is strange that the pytest here seems to fail intest_continuation.py, I have passed the test_continuation.py in my local machine.

[AL-377]

The changes have done

[rlouf]

Thank you for the contribution and sorry for the delay in reviewing. Will get to it soon.

stale

[brandonwillard]

@AL-377, this was a great fix/enhancement; much appreciated! I've added some minor refactoring and it should be ready to merge once everything finishes in CI.

[AL-377]

@AL-377, this was a great fix/enhancement; much appreciated! I've added some minor refactoring and it should be ready to merge once everything finishes in CI.

👍👍👍

[AL-377]

Thank you for the contribution and sorry for the delay in reviewing. Will get to it soon.

Never mind！