Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

improve partial Codecov #1172

Merged
merged 15 commits into from
Mar 19, 2020
Merged

improve partial Codecov #1172

merged 15 commits into from
Mar 19, 2020

Conversation

Borda
Copy link
Member

@Borda Borda commented Mar 17, 2020

What does this PR do?

Partial work on #463 increasing to 91%

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

@Borda Borda added the ci Continuous Integration label Mar 17, 2020
@Borda Borda added this to the 0.7.2 milestone Mar 17, 2020
@Borda Borda requested a review from a team March 17, 2020 18:09
@pep8speaks
Copy link

pep8speaks commented Mar 17, 2020

Hello @Borda! Thanks for updating this PR.

Line 23:101: E501 line too long (106 > 100 characters)
Line 24:101: E501 line too long (108 > 100 characters)

Line 3:101: E501 line too long (101 > 100 characters)

Line 23:101: E501 line too long (105 > 100 characters)

Line 34:101: E501 line too long (103 > 100 characters)

Line 16:101: E501 line too long (104 > 100 characters)

Line 7:101: E501 line too long (106 > 100 characters)

Line 38:101: E501 line too long (103 > 100 characters)
Line 69:101: E501 line too long (107 > 100 characters)

Line 18:101: E501 line too long (102 > 100 characters)

Comment last updated at 2020-03-18 20:36:26 UTC

@codecov
Copy link

codecov bot commented Mar 17, 2020

Codecov Report

Merging #1172 into master will increase coverage by 2%.
The diff coverage is 95%.

@@          Coverage Diff           @@
##           master   #1172   +/-   ##
======================================
+ Coverage      89%     91%   +2%     
======================================
  Files          62      62           
  Lines        3164    3093   -71     
======================================
- Hits         2810    2802    -8     
+ Misses        354     291   -63     

@williamFalcon williamFalcon changed the title impruve Codecov improve Codecov Mar 17, 2020
@williamFalcon
Copy link
Contributor

@Borda no tensorboardx... keep it pytorch summaryWriter please

@Borda
Copy link
Member Author

Borda commented Mar 18, 2020

@bmartinn could you help why the Trains tests are failing?

@bmartinn
Copy link
Contributor

@Borda sure, I'll take a look.
I think I have an idea on what the problem is, I'll work on a fix.

@bmartinn
Copy link
Contributor

bmartinn commented Mar 18, 2020

@Borda I just pushed a fix as a PR on the Codecov branch
See original commit here (based on codecov branch)
bmartinn@8b99bcb

* Add TrainsLogger.set_credentials to control trains server configuration and authentication from code. Sync trains package version.
Fix CI Trains tests
@Borda
Copy link
Member Author

Borda commented Mar 18, 2020

@bmartinn merger you PR here but the failer is the same?
is seems that it complains about existing names or so?
Also curious, does it work also offline?

@Borda Borda changed the title improve Codecov improve partial Codecov Mar 18, 2020
@Borda Borda marked this pull request as ready for review March 18, 2020 11:12
@bmartinn
Copy link
Contributor

Hi @Borda,

It seems like two Loggers are running simultaneously, is this possible ?

Trains is all about logging all the outputs/logs/console/artifacts to the trains-server (usually self hosted). So yes, currently there is no offline mode. That said I could easily add "bypass" argument, making sure the interface works, and it will just bypass sending data to the trains-server.

What do you think?

@Borda
Copy link
Member Author

Borda commented Mar 18, 2020

@bmartinn Well we have not changed anything on CI side and it was passing before..
In particular, we are sure that Drone runs only one ob in concurrency, @luiscape ring?

@bmartinn
Copy link
Contributor

Hmmm, anyhow it might be safer to have "bypass_mode"...
@Borda, I can PR a commit on the Codecov branch if you like

@Borda
Copy link
Member Author

Borda commented Mar 18, 2020

@bmartinn that would be great! Thx

@bmartinn
Copy link
Contributor

bmartinn commented Mar 18, 2020

@Borda , Done :)
#1187

* Add global TrainsLogger set_bypass_mode skips all external communication

Co-authored-by: bmartinn <>
Copy link
Contributor

@williamFalcon williamFalcon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

awesome! let's keep getting the coverage up :)

Copy link
Contributor

@neggert neggert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, but at some point we should do an audit of lines that have pragma: no-cover. IMO some of theses should be included in coverage.

@Borda
Copy link
Member Author

Borda commented Mar 18, 2020

Looks good, but at some point we should do an audit of lines that have pragma: no-cover. IMO some of theses should be included in coverage.

I do agree, we need to work more on tests, but with this kind of commented lines and functional visual codecov UI it is much easier to spot weakness in the package...
Note that this is just one of several upcoming PRs on getting better coverage but I would like to keep it in smaller chunks :]

@Borda Borda added the ready PRs ready to be merged label Mar 18, 2020
@williamFalcon williamFalcon merged commit 22a7264 into master Mar 19, 2020
@Borda Borda deleted the codecov branch March 19, 2020 13:23
tullie pushed a commit to tullie/pytorch-lightning that referenced this pull request Apr 3, 2020
* ignore in setup

* show report

* abs imports

* abstract pass

* cover loggers

* doctest trains

* locals

* pass

* revert tensorboard

* use tensorboardX

* revert tensorboardX

* fix trains

* Add TrainsLogger.set_credentials (Lightning-AI#1179)

* Add TrainsLogger.set_credentials to control trains server configuration and authentication from code. Sync trains package version.
Fix CI Trains tests

* Add global TrainsLogger set_bypass_mode (Lightning-AI#1187)

* Add global TrainsLogger set_bypass_mode skips all external communication

Co-authored-by: bmartinn <>

* rm some no-cov

Co-authored-by: Martin.B <51887611+bmartinn@users.noreply.github.com>
@Borda Borda modified the milestones: v0.7., v0.7.x Apr 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Continuous Integration ready PRs ready to be merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants