Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CPU][WIP] Allow releasing intermediate tensors #25944

Closed
wants to merge 33 commits into from
Closed

[CPU][WIP] Allow releasing intermediate tensors #25944

wants to merge 33 commits into from

Conversation

maxnick
Copy link
Contributor

@maxnick maxnick commented Aug 6, 2024

Details:

Support releasing memory allocated for the intermediate tensors each infer request.

Tickets:

@maxnick maxnick added the WIP work in progress label Aug 6, 2024
@maxnick maxnick added this to the 2024.4 milestone Aug 6, 2024
@github-actions github-actions bot added the category: CPU OpenVINO CPU plugin label Aug 6, 2024
@maxnick
Fix tests build
5ced5f4
@maxnick
Remove incorrect checs from Input
e2440df
@maxnick
Remove incorrect isDefined checks
d1b544e
@maxnick
Redefine Split createPrimitive method
0bf53b8
@maxnick
Memory subsytem refactoring
e20e7f2
@maxnick
Merge remote-tracking branch 'origin/master' into flush_interim_tensors
3db1617
@maxnick
Avoid using key word
bbbcdf4
@maxnick
Bug fixes
692c02f
@maxnick
Fix linear offset calculation in static block
ece559e
@maxnick
Fix output edges processing
b9da47a
@maxnick
Add allocate and free actions
8304f77
@maxnick
Add flushing intermediate tensors
e58f01a
@maxnick
Linter fixes
334b757
@maxnick
Avoid calling getData to not allocated memory
b0d0964
@maxnick
Merge remote-tracking branch 'origin/master' into flush_interim_tensors
bfe54a0
@maxnick
Reallocate only defined mem
f6a8dee
@maxnick
Refactor the Reorder node
01bb93c
@maxnick
Refactor set output default ptr
1adc24c
@maxnick
Adapt FC executor
fd3b99a
@maxnick
Fix dynamic memory allocation
548e2d7
@maxnick
Adapt Multimodal node
2722aeb
@maxnick
Skip memory refresh for inPlace up
906d649
@maxnick
Skip string tensors in memory refresh
5c41e7c
@maxnick
Avoid reading uninit data in Loop initialization
f570550
@maxnick
Merge remote-tracking branch 'origin/master' into flush_interim_tensors
5b9d05a
@maxnick maxnick marked this pull request as ready for review August 27, 2024 13:09
@maxnick maxnick requested review from a team as code owners August 27, 2024 13:09
@maxnick maxnick requested a review from a team as a code owner August 27, 2024 16:34
@github-actions github-actions bot added category: CI OpenVINO public CI github_actions Pull requests that update GitHub Actions code labels Aug 27, 2024
@github-actions github-actions bot removed category: CI OpenVINO public CI github_actions Pull requests that update GitHub Actions code labels Aug 28, 2024
@maxnick
Copy link
Contributor Author

maxnick commented Sep 5, 2024

This PR has been included to #26262 .

@maxnick maxnick closed this Sep 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: CPU OpenVINO CPU plugin WIP work in progress
Projects
None yet
Milestone
2024.4
Development

Successfully merging this pull request may close these issues.
1 participant
@maxnick