-
Notifications
You must be signed in to change notification settings - Fork 3.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OpenVINO(TM) Toolkit support #1235
base: master
Are you sure you want to change the base?
Conversation
Shall we test and merge this? |
Seems to work and give a 30 % performance boost on Intel CPU |
works with 2024.3? and let me put a few folks validating it :) |
Can you please share the instructions to install or build this setup? |
so I did git clone and checkout this then, here is an error Installed /home2/raymondlo84/EasyOCR/EasyOCR/venv/lib/python3.10/site-packages/openvino_telemetry-2024.1.0-py3.10.egg
When I run the sample, here we got this
How do I build this without using CUDA? I think it maybe related to that? |
Glad that you were able to successfully run EasyOCR with OpenVINO backend. Which exact Intel CPU did you use for the test? On the latest generations of Intel(R)Core and Intel(R) Xeon CPUs performance boost should be bigger. |
$ python3 -m venv env |
Looks like it is install lots of CUDA stuffs :| Using legacy 'setup.py install' for easyocr, since package 'wheel' is not installed. shall we make a cleaner version with OV? (venv) raymondlo84@4thSPR-Flex:~/EasyOCR/EasyOCR/examples$ python test.py With no OV works. |
And with OV works too :) |
AND GPU works (I got Intel Flex!!)
|
Intel Xeon-E 2274G, this was the only CPU available to me. I didn't try the GPU though |
I tested it and It would work on intel laptop's iGPU too. (Tried it on Intel Core Ultra) |
What's the speedups you are seeing? |
It depends on several factors like input picture size, language, CPU/GPU model, etc. On Intel® Core™ Ultra CPU the speedup was ~3.5x comparing with Pytorch CPU, on 5th Gen Intel® Xeon® Scalable from 3x up to 5.8x comparing with Pytorch CPU. |
Add a support for OpenVINO(TM) - toolkit for optimizing and deploying AI inference. This pull request allows to accelerate EasyOCR on Intel(R) platforms: Intel(R) CPU, Intel(R) Processor Graphics or Intel(R) Discrete Graphics.