Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Traversal can end up keeping large amounts of path metadata #434

Open
willscott opened this issue May 24, 2022 · 0 comments
Open

Traversal can end up keeping large amounts of path metadata #434

willscott opened this issue May 24, 2022 · 0 comments
Assignees
Labels
need/analysis Needs further analysis before proceeding

Comments

@willscott
Copy link
Member

as seen in the legs synchronization filecoin-project/go-legs#126 we ended up seeing memory exhaustion at traversals of ~10,000 depth, and ended up segmenting the traversal process into smaller selectors limited to 2000 levels of recursion as a stop-gap.

That seems really small and like something has gone wrong at the traversal level to warrant that.

@rvagg rvagg added the need/analysis Needs further analysis before proceeding label May 25, 2022
@rvagg rvagg self-assigned this Aug 2, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
need/analysis Needs further analysis before proceeding
Projects
Status: 🗄️ Backlog
Development

No branches or pull requests

2 participants