-
Notifications
You must be signed in to change notification settings - Fork 885
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to show progress bar in pipeline? [QUESTION] #1323
Comments
Sorry, but that functionality currently does not exist (for the tokenize
annotator, at least)
|
thank you for your timely reply. Another question emerges while I was test running the tokenizing pipeline, that presently the GPU utilization rate is rather low (5% to 14% of my rtx 3070), how to maximize the GPU usage so as to make the whole process faster? the data was the NYT annotated corpus, and there are 100'000 articles in the dataframe |
Certain annotators do quite a bit of their manipulation on the CPU. Fixing that and getting better GPU utilization would be a bit of a project. It is on the list of things to do, though |
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. |
Hi, I have been using stanza bulkprocess to tokenize and ssplit a rather large text stored in a dataframe.
My question is how to show progress bar when running the pipeline?
The text was updated successfully, but these errors were encountered: