Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

grpc max message length update #227

Merged
merged 1 commit into from
Sep 13, 2022
Merged

Conversation

myungjin
Copy link
Contributor

There is a message limit in gRPC. The default value is about 4MB defined in GRPC_DEFAULT_MAX_RECV_MESSAGE_LENGTH in grpc_types.h from grpc source code.

This limitation creates ExecuteBatchError or returns an error status code such as StatusCode.RESOURCE_EXHAUSTED.

In order to mitigate the issue, 'grpc.max_send_message_length' and 'grpc.max_receive_message_length' in both client and server are increased to 1GB.

There is a message limit in gRPC. The default value is about 4MB
defined in GRPC_DEFAULT_MAX_RECV_MESSAGE_LENGTH in grpc_types.h from
grpc source code.

This limitation creates ExecuteBatchError or returns an error status
code such as StatusCode.RESOURCE_EXHAUSTED.

In order to mitigate the issue, 'grpc.max_send_message_length' and
'grpc.max_receive_message_length' in both client and server are
increased to 1GB.
@myungjin myungjin linked an issue Sep 13, 2022 that may be closed by this pull request
@codecov-commenter
Copy link

Codecov Report

Merging #227 (8ef4ab7) into main (c6cc492) will not change coverage.
The diff coverage is n/a.

@@           Coverage Diff           @@
##             main     #227   +/-   ##
=======================================
  Coverage   22.41%   22.41%           
=======================================
  Files          35       35           
  Lines        1593     1593           
=======================================
  Hits          357      357           
  Misses       1226     1226           
  Partials       10       10           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

@myungjin myungjin merged commit f01a459 into cisco-open:main Sep 13, 2022
@myungjin myungjin deleted the grpc_buf_size branch September 13, 2022 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Flame with grpc backend hangs for larger model like resnet50
2 participants