Start accumulate gradients schedule at epoch 0 (continued)

[HHousen]

What does this PR do?

Continuation of #2490.

Fixes #2480. If the pl.Trainer option accumulate_grad_batches was an integer then the first epoch (epoch 0) would use accumulate_grad_batches=1 while the remaining epochs would use accumulate_grad_batches=<user_value>. This was caused by #2289.

Before:

After:

Before submitting

• Was this discussed/approved via a Github issue? (no need for typos and docs improvements)
• Did you read the contributor guideline, Pull Request section?
• Did you make sure your PR does only one thing, instead of bundling different changes together? Otherwise, we ask you to create a separate PR for every change.
• Did you make sure to update the documentation with your changes?
• Did you write any new necessary tests?
• Did you verify new and existing tests pass locally with your changes?
• If you made a notable change (that affects users), did you update the CHANGELOG?

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

[codecov]

Codecov Report

Merging #2513 into master will decrease coverage by 1%.
The diff coverage is 100%.

@@          Coverage Diff           @@
##           master   #2513   +/-   ##
======================================
- Coverage      88%     87%   -1%     
======================================
  Files          69      69           
  Lines        5540    5628   +88     
======================================
- Hits         4900    4899    -1     
- Misses        640     729   +89     

[awaelchli]

nice, this looks good!

[pep8speaks]

Hello @HHousen! Thanks for updating this PR.

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2020-07-06 00:24:32 UTC