Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ENH: adding support for Py3.6+ memory tracing for khash-maps #38048

Merged
merged 9 commits into from
Nov 26, 2020

Conversation

realead
Copy link
Contributor

@realead realead commented Nov 24, 2020

  • tests added / passed
  • passes black pandas
  • passes git diff upstream/master -u -- "*.py" | flake8 --diff
  • whatsnew entry

Tracemalloc is a standard tool for tracing of memory consumption in Python. Until now khash-maps were invisible for this tool.

This PR follows more or less numpy's approach (see numpy/numpy@03534ec) for adding tracemalloc-support.

This PR fixes also silly mistakes from #37920 (see 3291ed1) and the somewhat imprecise implementation of sizeof for XXXHashTable-classes.

@jreback jreback added Benchmark Performance (ASV) benchmarks Performance Memory or execution speed performance labels Nov 26, 2020
@jreback jreback added this to the 1.2 milestone Nov 26, 2020
@jreback jreback merged commit 1fc5efd into pandas-dev:master Nov 26, 2020
@jreback
Copy link
Contributor

jreback commented Nov 26, 2020

thanks @realead very nice

@realead realead deleted the tracemalloc_for_khash branch November 27, 2020 08:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Benchmark Performance (ASV) benchmarks Performance Memory or execution speed performance
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants