Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Qiqqa sometimes reports Unexpected exception (OutOfMemory) when using Sniffer with large libraries #19

Closed
GerHobbelt opened this issue Aug 2, 2019 · 3 comments
Labels
🐛bug Something isn't working
Milestone

Comments

@GerHobbelt
Copy link
Collaborator

Exception thrown: Insufficient memory to continue the execution of the program

Running Qiqqa in the MSVC debugger and having a quick look at the memory footprint (snapshot inspection), it turns out that in this case the LDAStuff.DocProbability and LDAStuff.TopicProbability both are huge: Count > 3.5 million, Size > 70MB each.

The next memory hog (?) seems to be a WPF component: WpfTap.WpfVisualTreeService --> Dictionary component @ Count ~ 24K and Size ~ 35MB :: I bet that's the visual list of the entire library.

However, the LDAStuff is odd to me as I haven't used Qiqqa Expedition or anything else, except the Sniffer during this session.

2019-08-02-(1)A

@GerHobbelt
Copy link
Collaborator Author

GerHobbelt added a commit to GerHobbelt/qiqqa-open-source that referenced this issue Aug 2, 2019
GerHobbelt added a commit to GerHobbelt/qiqqa-open-source that referenced this issue Aug 2, 2019
GerHobbelt added a commit to GerHobbelt/qiqqa-open-source that referenced this issue Aug 5, 2019
… loading a saved session :-( ), we're augmenting the logging a tad to ease diagnosis. (jimmejardine#19)
@GerHobbelt
Copy link
Collaborator Author

Seems fixed as per #33.

This has been an elusive bugger and a lot of time has been spent on IDisposables tracking and other post-partum cleanup matters in the code. memory leaks in C# have always been a horror to track down so I cannot guarantee that it's been fixed. 😞

This has also triggered me to run a Code Analysis Report on the codebase (MSVS: pick Solution > Analyze and Code Cleanup > Run Code Analysis on Solution (Alt+F11) which has led to quite a bit of code inspection and activity - see the CAxxxx commits in the tree.

Considered done; any future work on this should be filed in another issue.

@GerHobbelt GerHobbelt changed the title Qiqqa sometimes reports Unexpected exception (OutOfMemory) when using Sniffer with large libraries ✅Qiqqa sometimes reports Unexpected exception (OutOfMemory) when using Sniffer with large libraries Aug 8, 2019
@GerHobbelt
Copy link
Collaborator Author

Closing and decluttering the issue list so it stays workable for me: fixed in https://github.com/GerHobbelt/qiqqa-open-source mainline=master branch, pending #15 / any maintainer rights/actions.

@GerHobbelt GerHobbelt added the 🐛bug Something isn't working label Oct 4, 2019
@GerHobbelt GerHobbelt added this to the v82 milestone Oct 4, 2019
@GerHobbelt GerHobbelt changed the title ✅Qiqqa sometimes reports Unexpected exception (OutOfMemory) when using Sniffer with large libraries Qiqqa sometimes reports Unexpected exception (OutOfMemory) when using Sniffer with large libraries Oct 4, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant