Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a final report to all pytest jobs #6861

Merged
merged 1 commit into from
Sep 1, 2020
Merged

Conversation

stas00
Copy link
Contributor

@stas00 stas00 commented Sep 1, 2020

we had it added for one job (run_examples_torch), please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!

To remind pytest -rA finalizes the test run with a report like this:

PASSED examples/seq2seq/test_seq2seq_examples.py::test_seq2seq_dataset_truncation[patrickvonplaten/t5-tiny-random]
PASSED examples/seq2seq/test_seq2seq_examples.py::test_seq2seq_dataset_truncation[sshleifer/bart-tiny-random]
PASSED examples/seq2seq/test_seq2seq_examples.py::test_seq2seq_dataset_truncation[google/pegasus-xsum]
PASSED examples/seq2seq/test_seq2seq_examples.py::test_legacy_dataset_truncation[sshleifer/bart-tiny-random]
PASSED examples/seq2seq/test_seq2seq_examples.py::test_legacy_dataset_truncation[bert-base-cased]
PASSED examples/test_examples.py::ExamplesTests::test_run_language_modeling
PASSED examples/test_examples.py::ExamplesTests::test_run_pl_glue
PASSED examples/test_examples.py::ExamplesTests::test_run_squad
PASSED examples/bert-loses-patience/test_run_glue_with_pabee.py::PabeeTests::test_run_glue
SKIPPED [1] examples/seq2seq/test_bash_script.py:25: too slow to run on CPU
SKIPPED [1] examples/seq2seq/test_bash_script.py:32: too slow to run on CPU

we had it added for one job, please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!
@codecov
Copy link

codecov bot commented Sep 1, 2020

Codecov Report

Merging #6861 into master will increase coverage by 3.38%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #6861      +/-   ##
==========================================
+ Coverage   76.81%   80.20%   +3.38%     
==========================================
  Files         157      157              
  Lines       28795    28795              
==========================================
+ Hits        22118    23094     +976     
+ Misses       6677     5701     -976     
Impacted Files Coverage Δ
src/transformers/modeling_tf_electra.py 25.13% <0.00%> (-73.83%) ⬇️
src/transformers/modeling_tf_openai.py 22.58% <0.00%> (-72.26%) ⬇️
src/transformers/tokenization_bart.py 42.10% <0.00%> (-57.90%) ⬇️
src/transformers/modeling_marian.py 60.00% <0.00%> (-30.00%) ⬇️
src/transformers/modeling_t5.py 77.63% <0.00%> (-6.02%) ⬇️
src/transformers/activations.py 85.00% <0.00%> (-5.00%) ⬇️
src/transformers/tokenization_dpr.py 53.15% <0.00%> (-4.51%) ⬇️
src/transformers/tokenization_auto.py 95.55% <0.00%> (-2.23%) ⬇️
src/transformers/modeling_openai.py 80.96% <0.00%> (-1.30%) ⬇️
src/transformers/modeling_bart.py 95.08% <0.00%> (-0.51%) ⬇️
... and 25 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 431ab19...39d237c. Read the comment docs.

@sgugger sgugger merged commit 59a6a32 into huggingface:master Sep 1, 2020
@stas00 stas00 deleted the patch-1 branch September 1, 2020 02:52
Zigur pushed a commit to Zigur/transformers that referenced this pull request Oct 26, 2020
we had it added for one job, please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!
fabiocapsouza pushed a commit to fabiocapsouza/transformers that referenced this pull request Nov 15, 2020
we had it added for one job, please add it to all pytest jobs - we need the output of what tests were run to debug the codecov issue. thank you!
fabiocapsouza added a commit to fabiocapsouza/transformers that referenced this pull request Nov 15, 2020
hjptriplebee pushed a commit to hjptriplebee/transformers that referenced this pull request Jun 29, 2021
This pull request was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants