Skip to content

Commit

Permalink
Change the default message for requester.py and move mlperf 4.1 insta…
Browse files Browse the repository at this point in the history
…ll (#136)

for proxy version support.

using a more positive default message for requester.py.

Co-authored-by: Zhihao Shan <zhihaoshan@google.com>
  • Loading branch information
zhihaoshan-google and Zhihao Shan authored Sep 5, 2024
1 parent 93de590 commit 445f1aa
Show file tree
Hide file tree
Showing 3 changed files with 1 addition and 4 deletions.
2 changes: 0 additions & 2 deletions jetstream/tools/proxy_dev/base.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -22,9 +22,7 @@ RUN pip install setuptools==58 fastapi==0.103.2 uvicorn

RUN pip install ./JetStream

COPY inference_mlperf4.1 ./inference_mlperf4.1
RUN apt -y update && apt-get -y install python3-dev && apt-get -y install build-essential
RUN pip install ./inference_mlperf4.1/loadgen
RUN pip install \
transformers==4.31.0 \
nltk==3.8.1 \
Expand Down
1 change: 0 additions & 1 deletion jetstream/tools/proxy_dev/dev.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,6 @@ ENV JAX_BACKEND_TARGET=grpc://localhost:38681
# Copy all files from local workspace into docker container
COPY JetStream ./JetStream
COPY maxtext ./maxtext
COPY inference_mlperf4.1 ./inference_mlperf4.1

RUN pip install ./JetStream
RUN pip install -r ./maxtext/requirements.txt
Expand Down
2 changes: 1 addition & 1 deletion jetstream/tools/requester.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@

_SERVER = flags.DEFINE_string("server", "0.0.0.0", "server address")
_PORT = flags.DEFINE_string("port", "9000", "port to ping")
_TEXT = flags.DEFINE_string("text", "Today is a good day", "The message")
_TEXT = flags.DEFINE_string("text", "My dog is cute", "The message")
_MAX_TOKENS = flags.DEFINE_integer(
"max_tokens", 3, "Maximum number of output/decode tokens of a sequence"
)
Expand Down

0 comments on commit 445f1aa

Please sign in to comment.