Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate: fix SlidingWindowCache.reset() #31917

Merged
merged 1 commit into from
Jul 11, 2024

Conversation

gante
Copy link
Member

@gante gante commented Jul 11, 2024

What does this PR do?

RUN_SLOW=1 py.test tests/models/mistral/test_modeling_mistral.py::MistralIntegrationTest::test_compile_static_cache is failing due to the reset function in the sliding window cache, which is incorrect

(possibly the result of a bad merge conflict? this used to be the old code)

@gante gante requested a review from amyeroberts July 11, 2024 18:08
@gante gante changed the title Generate: fix sliding cache Generate: fix sliding window cache Jul 11, 2024
@gante gante changed the title Generate: fix sliding window cache Generate: fix SlidingWindowCache.reset() Jul 11, 2024
@HuggingFaceDocBuilderDev

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Collaborator

@amyeroberts amyeroberts left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing!

@amyeroberts amyeroberts merged commit 6a05f68 into huggingface:main Jul 11, 2024
21 checks passed
@gante gante deleted the fix_sliding branch July 11, 2024 19:05
amyeroberts pushed a commit to amyeroberts/transformers that referenced this pull request Jul 19, 2024
MHRDYN7 pushed a commit to MHRDYN7/transformers that referenced this pull request Jul 23, 2024
zucchini-nlp pushed a commit to zucchini-nlp/transformers that referenced this pull request Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants