Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Snippets] Added dynamic memory sharing support #27175

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[Snippets] Added dynamic memory sharing support #27175

wants to merge 2 commits into from
+1,332 −891

Conversation

a-sidorova
Copy link
Contributor

@a-sidorova a-sidorova commented Oct 22, 2024 •
edited
Loading

Details:

  • Added memory inplace support for Buffer with different precision (it's supported only when output Buffer has data size not more than input Buffer) - it's needed for BF16 and INT8 MHA
  • Added memory inplace support for dynamic Buffers with the marking pass "MarkInvariantShapePath"

Tickets:

  • 154732, 150148

Prerequisites:

@github-actions github-actions bot added category: IE Tests OpenVINO Test: plugins and common category: CPU OpenVINO CPU plugin labels Oct 22, 2024
@a-sidorova a-sidorova force-pushed the feature/snippets/buffers_inplace branch from 2f6efd8 to e2a44f4 Compare October 22, 2024 09:46
@a-sidorova a-sidorova force-pushed the feature/snippets/buffers_inplace branch from e2a44f4 to 4d0cfc8 Compare October 22, 2024 12:04
@a-sidorova a-sidorova marked this pull request as ready for review October 22, 2024 12:05
@a-sidorova a-sidorova requested review from a team as code owners October 22, 2024 12:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@v-Golubev v-Golubev Awaiting requested review from v-Golubev

@IvanNovoselov IvanNovoselov Awaiting requested review from IvanNovoselov

At least 1 approving review is required to merge this pull request.

Assignees

@v-Golubev v-Golubev

@IvanNovoselov IvanNovoselov

Labels
category: CPU OpenVINO CPU plugin category: IE Tests OpenVINO Test: plugins and common
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@a-sidorova @v-Golubev @IvanNovoselov