Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more nlp ci tests #340

Merged
merged 8 commits into from
Feb 7, 2020
Merged

Add more nlp ci tests #340

merged 8 commits into from
Feb 7, 2020

Conversation

yzhang123
Copy link
Contributor

ci tests added:

  • bert pretraining on wikitext2, with online preprocessing
  • bert pretraining on mini version wiki+bookcorpus, offline preprocessed
    -squad1
    -squad2
    -asr_postprocessor
    unit test deleted:
    -squad unittest for training
    unit test added:
    -squad set up
    made tts ci test more error safe

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix black style

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update folder name

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

add

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

files not used in unittest, moved to ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

add nemo import

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

adding bert ci pretraining

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update Jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

adding bert preprocessed ci test

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

adding bert preprocessed ci test

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

adding squad ci tests

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

updated Jenkins file

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix bug

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix style

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

update jenkins

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

delete test squad unittest and move to ci

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>

fix style

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@yzhang123 yzhang123 requested a review from blisc February 7, 2020 04:54
@lgtm-com
Copy link

lgtm-com bot commented Feb 7, 2020

This pull request introduces 4 alerts when merging 6e95c63 into 4f299f4 - view on LGTM.com

new alerts:

  • 2 for Unused import
  • 2 for Module is imported with 'import' and 'import from'

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@lgtm-com
Copy link

lgtm-com bot commented Feb 7, 2020

This pull request introduces 4 alerts when merging 1110589 into 4f299f4 - view on LGTM.com

new alerts:

  • 2 for Unused import
  • 2 for Module is imported with 'import' and 'import from'

Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@yzhang123 yzhang123 requested a review from ekmb February 7, 2020 19:31
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@yzhang123 yzhang123 requested a review from ekmb February 7, 2020 21:36
Signed-off-by: Yang Zhang <yangzhang@nvidia.com>
@ekmb ekmb merged commit c6a3cdd into master Feb 7, 2020
@yzhang123 yzhang123 deleted the add_more_nlp_ci_tests branch February 7, 2020 21:57
dcurran90 pushed a commit to dcurran90/NeMo that referenced this pull request Oct 15, 2024
The lab generate step requires about 10GB.  A full run through the
process on Apple hardware with MLX takes almost 60GB locally.

Signed-off-by: Josh Boyer <jwboyer@redhat.com>
Co-authored-by: Martin Hickey <martin.hickey@ie.ibm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants