Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

multi gpu support for lstm layer #4851

Closed
zachluo opened this issue Oct 17, 2016 · 4 comments
Closed

multi gpu support for lstm layer #4851

zachluo opened this issue Oct 17, 2016 · 4 comments

Comments

@zachluo
Copy link

zachluo commented Oct 17, 2016

The implement of lstm layer in caffe is to use a sub-net. But it seems to fail to use multi gpu when training lstm. It outputs:
Check failed: Caffe::root_solver() || root_net_ root_net_ needs to be set for all non-root solvers
Any one meet this issue?

@cypof
Copy link
Member

cypof commented Oct 17, 2016

Does it work with the nccl version?

#4563

On Oct 17, 2016 8:41 AM, "zachluo" notifications@github.com wrote:

The implement of lstm layer in caffe is to use a sub-net. But it seems to
fail to use multi gpu when training lstm. It outputs:
Check failed: Caffe::root_solver() || root_net_ root_net_ needs to be set
for all non-root solvers
Any one meet this issue?


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#4851, or mute the thread
https://github.com/notifications/unsubscribe-auth/AA4RXtHfw9GecVF6nlL8eSq8IFp1SWXMks5q05cagaJpZM4KYxvm
.

@junshi15
Copy link

this PR addresses the problem.
#4806

@zachluo
Copy link
Author

zachluo commented Oct 28, 2016

as @junshi15 says, it works !

@shelhamer
Copy link
Member

Note this is solved by further releases in the switch to NCCL #4563, which is included in 1.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants