Use Pydantic to suggest and enforce response format

[rlouf]

AutoGPT's and BabyAGI's prompts contain instructions regarding the expected output format, but then use custom parsing code for the response. I suggest to let the user define the expected response format with Pydantic, and build the prompt directly from the Pydantic schema.

So the following instruction:

{
    "thoughts":
    {
        "text": "thought",
        "reasoning": "reasoning",
        "plan": "- short bulleted\n- list that conveys\n- long-term plan",
        "criticism": "constructive self-criticism",
        "speak": "thoughts summary to say to user"
    },
}

Could be passed by first defining and decorating the following schema:

import outlines.text as text
from pydantic import BaseModel, Field

@text.response
class Thoughts(BaseModel):
    text: str = Field(description="thought")
    reasoning: str = Field(description="reasoning")
    plan: str = Field(description="short bulleted list that conveys")
    criticism: str = Field(description="constructive self-criticism"
    speak: str = Field(description="thoughts summary to say to users")

So we can do:

import outlines.text as text

@text.prompt
def prompt(schema):
    """RESPONSE FORMAT:
    
     {{schema.description}}
    """

prompt(Thoughts)

And on an LLM response:

answer = Thoughts.parse(llm(query))