Skip to content

Commit

Permalink
Fix format in the BentoML doc
Browse files Browse the repository at this point in the history
Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
  • Loading branch information
Sherlock113 authored and rlouf committed May 6, 2024
1 parent db83c08 commit b7d876e
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion docs/cookbook/deploy-using-bentoml.md
Original file line number Diff line number Diff line change
Expand Up @@ -50,13 +50,14 @@ $ bentoml models list

Tag Module Size Creation Time
mistralai--mistral-7b-v0.1:m7lmf5ac2cmubnnz 13.49 GiB 2024-04-25 06:52:39
```

## Define a BentoML Service

As the model is ready, we can define a [BentoML Service](https://docs.bentoml.com/en/latest/guides/services.html) to wrap the capabilities of the model.

We will run the JSON-structured generation example [in the README](https://github.com/outlines-dev/outlines?tab=readme-ov-file#efficient-json-generation-following-a-json-schema), with the following schema:


```python
DEFAULT_SCHEMA = """{
"title": "Character",
Expand Down Expand Up @@ -206,6 +207,8 @@ Expected output:
"weapon": "sword",
"strength": 20
}
```

## Deploy to BentoCloud

After the Service is ready, you can deploy it to [BentoCloud](https://docs.bentoml.com/en/latest/bentocloud/get-started.html) for better management and scalability. [Sign up](https://cloud.bentoml.com/signup) if you haven't got a BentoCloud account.
Expand Down

0 comments on commit b7d876e

Please sign in to comment.