Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate embeddings with CPU only #80

Open
vulcano9 opened this issue Jan 9, 2024 · 1 comment
Open

Generate embeddings with CPU only #80

vulcano9 opened this issue Jan 9, 2024 · 1 comment

Comments

@vulcano9
Copy link

vulcano9 commented Jan 9, 2024

Hi @snexus,

Thank you for your support and patient response to my (beginner) questions. I truly appreciate your assistance.

I don't have a dedicated graphics card, but I am eager to create the embeddings.
Is there a way to achieve this without one (Google Colab unfortunately crashes after a certain period of time while creating embeddings with ~13000 chunks)?

Thank you again for your support and I look forward to hearing from you.

@snexus
Copy link
Owner

snexus commented Jan 11, 2024

Hi @vulcano9

Without GPU, it would take a few orders of magnitude longer (technically I didn't test it - but should be supported out of the box on a system without GPU).

If you need only the embeddings, Google Colab should be able to handle it. What is the error message? How many documents and what format/size are you trying to parse?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants