Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Kosmos 2.5 for Volta GPU #1587

Open
Borobo opened this issue Jun 25, 2024 · 0 comments
Open

Kosmos 2.5 for Volta GPU #1587

Borobo opened this issue Jun 25, 2024 · 0 comments
Assignees
@wolfshow

Comments

@Borobo
Copy link

Borobo commented Jun 25, 2024

I'm on a Volta GPU, I'm aware that flash attention is not compatible with them but I've seen that the kosmos 2.5 requirements.txt contains "xformers", but I haven't seen any implementation in the kosmos 2.5 code. Do you plan to use xformers as a fallback when flash_attn is not installed?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@wolfshow wolfshow

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@wolfshow @Borobo and others