Skip to content

Issues: pytorch/serve

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

352 Open 1,250 Closed
352 Open 1,250 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Model missing error - KServe - PyTorch
#3215 opened Jul 1, 2024 by Csehpi
Docker swarm with TorchServe workflow triaged Issue has been reviewed and triaged workflowx Issues related to workflow / ensemble models
#3206 opened Jun 26, 2024 by KD1994
4
WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance. java Pull requests that update Java code
#3204 opened Jun 24, 2024 by aalbersk
1
torchserve bloom7b1 demo Load model failed kfserving triaged Issue has been reviewed and triaged
#3202 opened Jun 22, 2024 by zqc2011hy
2
Handling of subsequent RegisterModel calls to Management gRPC endpoint with same model & version grpc
#3199 opened Jun 21, 2024 by mihaidusmanu
Locust monkey patching leads to test cross-talking
#3193 opened Jun 13, 2024 by mreso
@mreso
Worker dead and yet describe_model gives me worker.status: Ready
#3191 opened Jun 13, 2024 by MohamedAliRashad
pytest: test_example_torch_compile.py is faling
#3189 opened Jun 12, 2024 by agunapal v0.12.0
1
Running segment_anything_fast example locally triaged Issue has been reviewed and triaged
#3186 opened Jun 11, 2024 by yousofaly
1
Follow up on token authentication PR comments
#3185 opened Jun 7, 2024 by mreso v0.12.0
@udaij12
5
[RFC] Token Authorization by default
#3184 opened Jun 7, 2024 by udaij12
"Token Authorization" for gRPC
#3181 opened Jun 6, 2024 by udaij12
"Model mode control" for gRPC
#3180 opened Jun 6, 2024 by udaij12
ImportError: cannot import name 'packaging' from 'pkg_resources'
#3176 opened Jun 5, 2024 by Sieltek
4
Two-way authentication/Mutual SSL in gRPC enhancement New feature or request
#3172 opened Jun 3, 2024 by MohamedAliRashad
The service crashes if the model takes a long time to respond grpc
#3168 opened May 31, 2024 by yurkoff-mv
6
NotImplementedError: Cannot copy out of meta tensor; no data! + Models not generating output text
#3167 opened May 31, 2024 by bjorquera1
Make torchserve-kfs docker image multiplatform enhancement New feature or request kfserving
#3161 opened May 25, 2024 by DanielTemesgen
1
Enable token authentication as default enhancement New feature or request p0 high priority security
#3157 opened May 23, 2024 by lxning v0.12.0
@udaij12
install dependency via conda enhancement New feature or request p0 high priority
#3156 opened May 22, 2024 by lxning v0.12.0
@namannandan
Limit resource in docker compose and worker in model triaged Issue has been reviewed and triaged
#3150 opened May 21, 2024 by ToanLyHoa
@agunapal
2
Continuous Batching does not work with newest transformer issue
#3148 opened May 21, 2024 by udaij12
@mreso @lxning
question to model inference optimization triaged Issue has been reviewed and triaged
#3134 opened May 4, 2024 by geraldstanje
@agunapal
8
If micro_batch_size of micro-batch is set to 1, then model inference is still batch processing?
#3120 opened Apr 29, 2024 by pengxin233
1
CUDA out of Memory with low Memory Utilization (CUDA error: device-side assert triggered)
#3114 opened Apr 25, 2024 by emilwallner
5
ProTip! Find all open issues with in progress development work with linked:pr.