-
Notifications
You must be signed in to change notification settings - Fork 3.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Irreproducible Segfault with LightGBM #1743
Comments
Did you install LightGBM from PyPI? |
We are installing with pip install. It just hangs in a middle of an optimization. We can try compiling from source but is there a reason why PyPI may be broken? |
I guess there are something wrong with manylinux and |
Interesting. Have you or anyone else experienced this because we have been experiencing this a fair amount but I have not seen any big reported use cases? This seems like it would break the package from being used in production. |
@vruvora |
Yes. It has been happening a quite a bit as of late. We have automated statistical unit tests with sample datasets which may be a degenerate optimization problem. However, we use them to make sure our pipeline is in order when we have big changes. Generally, ~1/5 times it will segfault and it will stop once we do it again. |
I saw uncertain crash many times in my main job. |
@henry0312 Interesting. Have you been able to fix it? |
@vruvora you should be sure to uninstall the package from PyPI and install manually. |
@vruvora Yeah, installing from source have solved the problem. |
@henry0312 I will try this out and update accordingly. Thanks. @guolinke Do you know why source isn't up to date with PyPI? |
@vruvora you can use
as well. |
@henry0312 I am not very sure why Segfault happened, and why building from source can fix it. |
@guolinke Yes, |
@guolinke Will this be slower |
@vruvora have you solved your issue? |
@henry0312 Yes. As far as we know. No more segafults. |
should we add this problem and solution to the document? |
ping @henry0312 |
Yes. We should. |
yeah, I also think so. |
@vruvora A bit simplistic, the difference is in that regular @henry0312 Would you mind creating a PR with new FAQ entry about this? |
We are experiencing cases of irreproducible Segfault with LightGBM. Does anyone else have this issue?
Environment info
Operating System:
CPU/GPU model:
C++/Python/R version:
Error message
Reproducible examples
Steps to reproduce
The text was updated successfully, but these errors were encountered: