Speed up inference time. #5208
-
|
Hi ppl. Here u can see that the inference time, is around 200 ms. What GPU could i choose that runs faster than my 9100 CPU, around U$ 150 price range? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
@danielsoy I think almost any usable GPU will run faster than CPU, i.e. an NVIDIA 1080 Ti would be an easy place to start if you are on a budget. Even the K80, which is Colab's slowest GPU from several years ago runs default inference in about 30 ms:
|
Beta Was this translation helpful? Give feedback.
-
|
I can see that the 1080 Ti, has a compute capability of 6.1. So i will try to get something affordable for me, in this range. The python inference task, is taking 95% of the CPU bandwidth btw... Thanks again Glenn! |
Beta Was this translation helpful? Give feedback.
@danielsoy I think almost any usable GPU will run faster than CPU, i.e. an NVIDIA 1080 Ti would be an easy place to start if you are on a budget.
Even the K80, which is Colab's slowest GPU from several years ago runs default inference in about 30 ms: