-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Logging the learning rate #1205
Comments
Hi! thanks for your contribution!, great first issue! |
I think that's a great idea. Maybe it doesn't have to be a flag, it could be done by default like the other metrics that are already plotted automatically. Some things to consider:
|
For Adam it's a pickle. Maybe rather log the scheduler information i.e. its scaling of the initial learning rate. It would solve the group problems as well I guess. |
@PyTorchLightning/core-contributors do we want to add extra logging for LR or just stay with logging these extra parameters as a metric...? |
I proposed adding a |
I'd also stick to callbacks. However, for convenience we could provide an implementation of such a callback |
I have earlier implemented a callback that logs the learning rate for some experiments I did. I can bring it up to date and create a PR if wanted. |
Hey,
I think it would a cool feature to add a flag enabling the logging of the learning rate(s).
Thanks for your amazing work !
The text was updated successfully, but these errors were encountered: