Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Proposal] Memory tracker optimization #7553

Open
2 tasks done
xinyiZzz opened this issue Dec 31, 2021 · 0 comments
Open
2 tasks done

[Proposal] Memory tracker optimization #7553

xinyiZzz opened this issue Dec 31, 2021 · 0 comments
Labels
kind/feature Categorizes issue or PR as related to a new feature.

Comments

@xinyiZzz
Copy link
Contributor

xinyiZzz commented Dec 31, 2021

Design document: https://shimo.im/docs/DXvQPcqPH3TyR6pY

Motivation

  1. BE lacks memory access control, OOM frequently occurs during task execution,
  2. Users often report that BE consumes a lot of memory and cannot effectively locate the memory location;
  3. Cannot effectively limit the memory usage of a single query;

Expected Return

stability:

  1. Introduce memory access control to reduce process crashes caused by insufficient memory, and reject task submission when memory is insufficient;
  2. The current memory usage statistics can be more accurately observed and printed at any time, and Top Query and memory hot spots can be located;

Optimization direction

  1. MemTracker [Feature] Refactored memory statistics framework MemTracker #7196

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@xinyiZzz xinyiZzz added the kind/feature Categorizes issue or PR as related to a new feature. label Dec 31, 2021
@xinyiZzz xinyiZzz changed the title [Proposal] Memory management optimization [Proposal] Memory tracker optimization May 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature Categorizes issue or PR as related to a new feature.
Projects
None yet
Development

No branches or pull requests

1 participant