You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
At the moment, the POST /instance API endpoint has no way of knowing what our cluster level GPU capacity is. Whether k8s can actually scale or not. This causes weird issues where the frontend has to just do some guess work by polling the GET /instance API.
It would be nice to figure out a way to deal with this properly.
At the moment, the POST /instance API endpoint has no way of knowing what our cluster level GPU capacity is. Whether k8s can actually scale or not. This causes weird issues where the frontend has to just do some guess work by polling the GET /instance API.
It would be nice to figure out a way to deal with this properly.
cc @batpad @ingalls
The text was updated successfully, but these errors were encountered: