Skip to content

Commit

Permalink
Example update (#3231)
Browse files Browse the repository at this point in the history
* updating examples

* examples added

* spellcheck addition

* removing disable-token reference
  • Loading branch information
udaij12 committed Jul 8, 2024
1 parent f167702 commit 9a86e06
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 4 deletions.
3 changes: 1 addition & 2 deletions examples/Huggingface_Transformers/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -114,8 +114,7 @@ To register the model on TorchServe using the above model archive file, we run t
```
mkdir model_store
mv BERTSeqClassification.mar model_store/
torchserve --start --model-store model_store --models my_tc=BERTSeqClassification.mar --disable-token --ncs --disable-token-auth --enable-model-api
torchserve --start --model-store model_store --models my_tc=BERTSeqClassification.mar --ncs --disable-token-auth --enable-model-api
```

### Run an inference
Expand Down
2 changes: 1 addition & 1 deletion examples/pt2/torch_compile_hpu/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -74,7 +74,7 @@ PT_HPU_LAZY_MODE=0 torch-model-archiver --model-name resnet-50 --version 1.0 --m

Start the TorchServe server using the following command:
```bash
PT_HPU_LAZY_MODE=0 torchserve --start --ncs --disable-token --model-store model_store --models resnet-50.mar --disable-token-auth --enable-model-api
PT_HPU_LAZY_MODE=0 torchserve --start --ncs --model-store model_store --models resnet-50.mar --disable-token-auth --enable-model-api
```
`--disable-token` - this is an option that disables token authorization. This option is used here only for example purposes. Please refer to the torchserve [documentation](https://github.com/pytorch/serve/blob/master/docs/token_authorization_api.md), which describes the process of serving the model using tokens.

Expand Down
2 changes: 1 addition & 1 deletion examples/torch_tensorrt/torchcompile/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ torch-model-archiver --model-name res50-trt --handler image_classifier --version

#### Start TorchServe
```
torchserve --start --model-store model_store --models res50-trt=res50-trt.mar --disable-token --ncs --disable-token-auth --enable-model-api
torchserve --start --model-store model_store --models res50-trt=res50-trt.mar --ncs --disable-token-auth --enable-model-api
```

#### Run Inference
Expand Down

0 comments on commit 9a86e06

Please sign in to comment.