Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pass mpi environment variable to tox #724

Merged
merged 1 commit into from
Nov 7, 2022
Merged

Conversation

edknv
Copy link
Contributor

@edknv edknv commented Nov 7, 2022

The environment variable OPAL_PREFIX available in Merlin containers is not visible in unit tests because unit tests use tox, and tox blocks environment variables by default. Merlin Models recently added multi-GPU support using horovod that needs access to this environment variable. This PR passes this environment variable to the tox virtual environment in order to unblock tests in the CI that are failing, e.g., http://merlin-infra1.nvidia.com:8080/job/merlin_merlin/584/console.

Testing

Unblocks CI

@github-actions
Copy link

github-actions bot commented Nov 7, 2022

Documentation preview

https://nvidia-merlin.github.io/Merlin/review/pr-724

@nvidia-merlin-bot
Copy link
Contributor

Click to view CI Results
GitHub pull request #724 of commit 9b30f1a1dc444a9338ed8ea491101c4c339f71a7, no merge conflicts.
Running as SYSTEM
Setting status of 9b30f1a1dc444a9338ed8ea491101c4c339f71a7 to PENDING with url http://merlin-infra1.nvidia.com:8080/job/merlin_merlin/585/ and message: 'Pending'
Using context: Jenkins
Building on master in workspace /var/jenkins_home/workspace/merlin_merlin
using credential systems-login
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/NVIDIA-Merlin/Merlin # timeout=10
Fetching upstream changes from https://github.com/NVIDIA-Merlin/Merlin
 > git --version # timeout=10
using GIT_ASKPASS to set credentials login for merlin-systems
 > git fetch --tags --force --progress -- https://github.com/NVIDIA-Merlin/Merlin +refs/pull/724/*:refs/remotes/origin/pr/724/* # timeout=10
 > git rev-parse 9b30f1a1dc444a9338ed8ea491101c4c339f71a7^{commit} # timeout=10
Checking out Revision 9b30f1a1dc444a9338ed8ea491101c4c339f71a7 (detached)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 9b30f1a1dc444a9338ed8ea491101c4c339f71a7 # timeout=10
Commit message: "Pass mpi environment variable to tox"
 > git rev-list --no-walk 6eff853369055ed624e0fc2c3eb1c2374141bede # timeout=10
[merlin_merlin] $ /bin/bash /tmp/jenkins7810212156878247262.sh
GLOB sdist-make: /var/jenkins_home/workspace/merlin_merlin/merlin/setup.py
test-gpu recreate: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
test-gpu installdeps: pytest, pytest-cov
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu inst: /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/.tmp/package/1/merlin-0.0.1.zip
WARNING: Discarding $PYTHONPATH from environment, to override specify PYTHONPATH in 'passenv' in your configuration.
test-gpu installed: absl-py==1.2.0,aiohttp==3.8.1,aiosignal==1.2.0,alabaster==0.7.12,alembic==1.8.1,anyio==3.6.1,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,astroid==2.5.6,asttokens==2.0.8,astunparse==1.6.3,asv==0.5.1,asvdb==0.4.2,async-timeout==4.0.2,attrs==22.1.0,autopage==0.5.1,awscli==1.27.3,Babel==2.10.3,backcall==0.2.0,beautifulsoup4==4.11.1,betterproto==1.2.5,black==22.6.0,bleach==5.0.1,boto3==1.24.75,botocore==1.29.3,Brotli==1.0.9,cachetools==5.2.0,certifi==2019.11.28,cffi==1.15.1,chardet==3.0.4,charset-normalizer==2.1.1,clang==5.0,click==8.1.3,cliff==4.0.0,cloudpickle==2.2.0,cmaes==0.8.2,cmake==3.24.1.1,cmd2==2.4.2,colorama==0.4.4,colorlog==6.7.0,contourpy==1.0.5,coverage==6.5.0,cuda-python==11.7.1,cupy-cuda117==10.6.0,cycler==0.11.0,Cython==0.29.32,dask==2022.1.1,dbus-python==1.2.16,debugpy==1.6.3,decorator==5.1.1,defusedxml==0.7.1,dill==0.3.5.1,distlib==0.3.6,distributed==2022.5.1,distro==1.7.0,dm-tree==0.1.6,docker-pycreds==0.4.0,docutils==0.16,emoji==1.7.0,entrypoints==0.4,execnet==1.9.0,executing==1.0.0,faiss==1.7.2,faiss-gpu==1.7.2,fastai==2.7.9,fastapi==0.85.0,fastavro==1.6.1,fastcore==1.5.27,fastdownload==0.0.7,fastjsonschema==2.16.1,fastprogress==1.0.3,fastrlock==0.8,feast==0.19.4,fiddle==0.2.2,filelock==3.8.0,flatbuffers==1.12,fonttools==4.37.3,frozenlist==1.3.1,fsspec==2022.5.0,gast==0.4.0,gevent==21.12.0,geventhttpclient==2.0.2,gitdb==4.0.9,GitPython==3.1.27,google==3.0.0,google-api-core==2.10.1,google-auth==2.11.1,google-auth-oauthlib==0.4.6,google-pasta==0.2.0,googleapis-common-protos==1.52.0,graphviz==0.20.1,greenlet==1.1.3,grpcio==1.41.0,grpcio-channelz==1.49.0,grpcio-reflection==1.48.1,grpclib==0.4.3,h11==0.13.0,h2==4.1.0,h5py==3.7.0,HeapDict==1.0.1,horovod==0.26.1,hpack==4.0.0,httptools==0.5.0,hugectr2onnx==0.0.0,huggingface-hub==0.9.1,hyperframe==6.0.1,idna==2.8,imagesize==1.4.1,implicit==0.6.1,importlib-metadata==4.12.0,importlib-resources==5.9.0,iniconfig==1.1.1,ipykernel==6.15.3,ipython==8.5.0,ipython-genutils==0.2.0,ipywidgets==7.7.0,jedi==0.18.1,Jinja2==3.1.2,jmespath==1.0.1,joblib==1.2.0,json5==0.9.10,jsonschema==4.16.0,jupyter-cache==0.4.3,jupyter-core==4.11.1,jupyter-server==1.18.1,jupyter-server-mathjax==0.2.5,jupyter-sphinx==0.3.2,jupyter_client==7.3.5,jupyterlab==3.4.7,jupyterlab-pygments==0.2.2,jupyterlab-widgets==1.1.0,jupyterlab_server==2.15.1,keras==2.9.0,Keras-Preprocessing==1.1.2,kiwisolver==1.4.4,lazy-object-proxy==1.8.0,libclang==14.0.6,libcst==0.4.7,lightfm==1.16,lightgbm==3.3.2,linkify-it-py==1.0.3,llvmlite==0.39.1,locket==1.0.0,lxml==4.9.1,Mako==1.2.3,Markdown==3.4.1,markdown-it-py==1.1.0,MarkupSafe==2.1.1,matplotlib==3.6.0,matplotlib-inline==0.1.6,mdit-py-plugins==0.2.8,merlin==0.0.1,merlin-core==0.6.0+1.g5926fcf,merlin-models==0.7.0+11.g280956aa4,merlin-systems==0.5.0+4.g15074ad,mistune==2.0.4,mmh3==3.0.0,mpi4py==3.1.3,msgpack==1.0.4,multidict==6.0.2,mypy-extensions==0.4.3,myst-nb==0.13.2,myst-parser==0.15.2,natsort==8.1.0,nbclassic==0.4.3,nbclient==0.6.8,nbconvert==7.0.0,nbdime==3.1.1,nbformat==5.5.0,nest-asyncio==1.5.5,ninja==1.10.2.3,notebook==6.4.12,notebook-shim==0.1.0,numba==0.56.2,numpy==1.22.4,nvidia-pyindex==1.0.9,# Editable install with no version control (nvtabular==1.4.0+8.g95e12d347),-e /usr/local/lib/python3.8/dist-packages,nvtx==0.2.5,oauthlib==3.2.1,oldest-supported-numpy==2022.8.16,onnx==1.12.0,onnxruntime==1.11.1,opt-einsum==3.3.0,optuna==3.0.3,packaging==21.3,pandas==1.3.5,pandavro==1.5.2,pandocfilters==1.5.0,parso==0.8.3,partd==1.3.0,pathtools==0.1.2,pbr==5.11.0,pexpect==4.8.0,pickleshare==0.7.5,Pillow==9.2.0,pkgutil_resolve_name==1.3.10,platformdirs==2.5.2,plotly==5.11.0,pluggy==1.0.0,prettytable==3.5.0,prometheus-client==0.14.1,promise==2.3,prompt-toolkit==3.0.31,proto-plus==1.19.6,protobuf==3.19.5,psutil==5.9.2,ptyprocess==0.7.0,pure-eval==0.2.2,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pybind11==2.10.0,pycparser==2.21,pydantic==1.10.2,pydot==1.4.2,Pygments==2.13.0,PyGObject==3.36.0,pynvml==11.4.1,pyparsing==3.0.9,pyperclip==1.8.2,pyrsistent==0.18.1,pytest==7.1.3,pytest-cov==4.0.0,pytest-xdist==3.0.2,python-apt==2.0.0+ubuntu0.20.4.8,python-dateutil==2.8.2,python-dotenv==0.21.0,python-rapidjson==1.8,pytz==2022.2.1,PyYAML==5.4.1,pyzmq==24.0.0,regex==2022.9.13,requests==2.22.0,requests-oauthlib==1.3.1,requests-unixsocket==0.2.0,rsa==4.7.2,s3fs==2022.2.0,s3transfer==0.6.0,sacremoses==0.0.53,scikit-build==0.15.0,scikit-learn==1.1.2,scipy==1.8.1,seedir==0.3.0,Send2Trash==1.8.0,sentry-sdk==1.9.8,setproctitle==1.3.2,setuptools-scm==7.0.5,shortuuid==1.0.9,six==1.15.0,sklearn==0.0,smmap==5.0.0,sniffio==1.3.0,snowballstemmer==2.2.0,sortedcontainers==2.4.0,soupsieve==2.3.2.post1,Sphinx==5.3.0,sphinx-multiversion==0.2.4,sphinx-togglebutton==0.3.1,sphinx_external_toc==0.3.0,sphinxcontrib-applehelp==1.0.2,sphinxcontrib-copydirs @ git+https://github.com/mikemckiernan/sphinxcontrib-copydirs.git@bd8c5d79b3f91cf5f1bb0d6995aeca3fe84b670e,sphinxcontrib-devhelp==1.0.2,sphinxcontrib-htmlhelp==2.0.0,sphinxcontrib-jsmath==1.0.1,sphinxcontrib-qthelp==1.0.3,sphinxcontrib-serializinghtml==1.1.5,SQLAlchemy==1.4.43,stack-data==0.5.0,starlette==0.20.4,stevedore==4.1.0,stringcase==1.2.0,supervisor==4.1.0,tabulate==0.8.10,tblib==1.7.0,tdqm==0.0.1,tenacity==8.0.1,tensorboard==2.9.1,tensorboard-data-server==0.6.1,tensorboard-plugin-wit==1.8.1,tensorflow==2.9.2,tensorflow-estimator==2.9.0,tensorflow-gpu==2.9.2,tensorflow-io-gcs-filesystem==0.27.0,tensorflow-metadata==1.10.0,termcolor==2.0.1,terminado==0.15.0,testbook==0.4.2,threadpoolctl==3.1.0,tinycss2==1.1.1,tokenizers==0.10.3,toml==0.10.2,tomli==2.0.1,toolz==0.12.0,torch==1.12.1+cu113,torchmetrics==0.3.2,tornado==6.2,tox==3.26.0,tqdm==4.64.1,traitlets==5.4.0,transformers==4.12.0,transformers4rec==0.1.12+2.gbcc939255,treelite==2.3.0,treelite-runtime==2.3.0,tritonclient==2.25.0,typing-inspect==0.8.0,typing_extensions==4.3.0,uc-micro-py==1.0.1,urllib3==1.26.12,uvicorn==0.18.3,uvloop==0.17.0,versioneer==0.20,virtualenv==20.16.5,wandb==0.13.3,watchfiles==0.17.0,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.4.1,websockets==10.3,Werkzeug==2.2.2,widgetsnbextension==3.6.0,wrapt==1.12.1,xgboost==1.6.2,yarl==1.8.1,zict==2.2.0,zipp==3.8.1,zope.event==4.5.0,zope.interface==5.4.0
test-gpu run-test-pre: PYTHONHASHSEED='504797878'
test-gpu run-test: commands[0] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/systems.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/systems.git
  Cloning https://github.com/NVIDIA-Merlin/systems.git to /tmp/pip-req-build-dz102y19
  Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/systems.git /tmp/pip-req-build-dz102y19
  Resolved https://github.com/NVIDIA-Merlin/systems.git to commit d2737da6cc7e98ec8723731a7cc998aa143e6758
  Installing build dependencies: started
  Installing build dependencies: finished with status 'done'
  Getting requirements to build wheel: started
  Getting requirements to build wheel: finished with status 'done'
  Preparing metadata (pyproject.toml): started
  Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: nvtabular>=1.0.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.7.0+10.gd2737da) (1.1.1)
Requirement already satisfied: requests<3,>=2.10 in /usr/lib/python3/dist-packages (from merlin-systems==0.7.0+10.gd2737da) (2.22.0)
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-systems==0.7.0+10.gd2737da) (0.3.0+12.g78ecddd)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (4.64.1)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (21.3)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.2.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (7.0.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.3.5)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.10.0)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (0.55.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (3.19.5)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2022.5.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.2.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (8.1.3)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (6.1)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (5.8.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (65.4.1)
Collecting llvmlite<0.39,>=0.38.0rc1
  Downloading llvmlite-0.38.1-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (34.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 34.5/34.5 MB 33.3 MB/s eta 0:00:00
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-systems==0.7.0+10.gd2737da) (4.0.0)
Building wheels for collected packages: merlin-systems
  Building wheel for merlin-systems (pyproject.toml): started
  Building wheel for merlin-systems (pyproject.toml): finished with status 'done'
  Created wheel for merlin-systems: filename=merlin_systems-0.7.0+10.gd2737da-py3-none-any.whl size=91051 sha256=7039ce207197a2d726d38b2fe770f612625337d639fd18a062ebe3ed6f1d4c2b
  Stored in directory: /tmp/pip-ephem-wheel-cache-2aruoqe7/wheels/d3/db/b8/99d510a979c278774eda4142f1c0643c93b7b2674aff321c16
Successfully built merlin-systems
Installing collected packages: llvmlite, merlin-systems
  Attempting uninstall: llvmlite
    Found existing installation: llvmlite 0.39.1
    Not uninstalling llvmlite at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'llvmlite'. No files were found to uninstall.
  Attempting uninstall: merlin-systems
    Found existing installation: merlin-systems 0.5.0+4.g15074ad
    Not uninstalling merlin-systems at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
    Can't uninstall 'merlin-systems'. No files were found to uninstall.
Successfully installed llvmlite-0.38.1 merlin-systems-0.7.0+10.gd2737da

[notice] A new release of pip available: 22.2.2 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[1] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/models.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/models.git
Cloning https://github.com/NVIDIA-Merlin/models.git to /tmp/pip-req-build-87tf6l3y
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/models.git /tmp/pip-req-build-87tf6l3y
Resolved https://github.com/NVIDIA-Merlin/models.git to commit 42cd98c4c8e0fefd29d5e1b1507a88bb7600a265
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-models==0.9.0+32.g42cd98c4) (0.3.0+12.g78ecddd)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (4.64.1)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (21.3)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.2.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (7.0.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.3.5)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.10.0)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (0.55.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (3.19.5)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2022.5.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.2.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (8.1.3)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (6.1)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (5.8.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (65.4.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->merlin-models==0.9.0+32.g42cd98c4) (4.0.0)
Building wheels for collected packages: merlin-models
Building wheel for merlin-models (pyproject.toml): started
Building wheel for merlin-models (pyproject.toml): finished with status 'done'
Created wheel for merlin-models: filename=merlin_models-0.9.0+32.g42cd98c4-py3-none-any.whl size=363601 sha256=e06a43766726b937de76cd19d4df960a7aaeb946d764771d6890ec8a6b23b239
Stored in directory: /tmp/pip-ephem-wheel-cache-im48ds6p/wheels/5a/43/99/d50fe2c33b4f4686db73207ce3865e0d6be6609ffb03abade5
Successfully built merlin-models
Installing collected packages: merlin-models
Attempting uninstall: merlin-models
Found existing installation: merlin-models 0.7.0+11.g280956aa4
Not uninstalling merlin-models at /usr/local/lib/python3.8/dist-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-models'. No files were found to uninstall.
Successfully installed merlin-models-0.9.0+32.g42cd98c4

[notice] A new release of pip available: 22.2.2 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[2] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/NVTabular.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/NVTabular.git
Cloning https://github.com/NVIDIA-Merlin/NVTabular.git to /tmp/pip-req-build-7y750j2d
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/NVTabular.git /tmp/pip-req-build-7y750j2d
Resolved https://github.com/NVIDIA-Merlin/NVTabular.git to commit 8e7edbafd3006f56e73efdc0c01c4445ab57d028
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: scipy in /usr/local/lib/python3.8/dist-packages (from nvtabular==1.6.0+3.g8e7edbaf) (1.8.1)
Collecting merlin-dataloader>=0.0.2
Downloading merlin-dataloader-0.0.2.tar.gz (44 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.1/44.1 kB 1.6 MB/s eta 0:00:00
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: merlin-core>=0.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from nvtabular==1.6.0+3.g8e7edbaf) (0.3.0+12.g78ecddd)
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (4.64.1)
Requirement already satisfied: distributed>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2022.3.0)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (21.3)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.2.5)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (7.0.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.3.5)
Requirement already satisfied: dask>=2021.11.2 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2022.3.0)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.10.0)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (0.55.1)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (3.19.5)
Requirement already satisfied: numpy<1.25.0,>=1.17.3 in /var/jenkins_home/.local/lib/python3.8/site-packages (from scipy->nvtabular==1.6.0+3.g8e7edbaf) (1.20.3)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (0.12.0)
Requirement already satisfied: fsspec>=0.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2022.5.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.2.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (8.1.3)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (6.1)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (5.8.0)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (65.4.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2021.11.2->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core>=0.2.0->nvtabular==1.6.0+3.g8e7edbaf) (4.0.0)
Building wheels for collected packages: nvtabular, merlin-dataloader
Building wheel for nvtabular (pyproject.toml): started
Building wheel for nvtabular (pyproject.toml): finished with status 'done'
Created wheel for nvtabular: filename=nvtabular-1.6.0+3.g8e7edbaf-cp38-cp38-linux_x86_64.whl size=257744 sha256=3d7493141b617e411ef10814eb426fb8de0c958573e8d877d5f5972efad51852
Stored in directory: /tmp/pip-ephem-wheel-cache-e433kwvk/wheels/c2/16/76/39994bff39d812513de5b5572bff0903b9eb8f6c645b44cedc
Building wheel for merlin-dataloader (pyproject.toml): started
Building wheel for merlin-dataloader (pyproject.toml): finished with status 'done'
Created wheel for merlin-dataloader: filename=merlin_dataloader-0.0.2-py3-none-any.whl size=29205 sha256=95c6893f556b8bd018508e4fc8ecd16e2429db516eb8f07797bbbfe635d4f1fa
Stored in directory: /tmp/pip-ephem-wheel-cache-e433kwvk/wheels/d5/ce/8c/31476c01e0b5a2278110fe2092bdd911efb0e5b83d0d3550ca
Successfully built nvtabular merlin-dataloader
Installing collected packages: merlin-dataloader, nvtabular
Attempting uninstall: nvtabular
Found existing installation: nvtabular 1.1.1
Not uninstalling nvtabular at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'nvtabular'. No files were found to uninstall.
Successfully installed merlin-dataloader-0.0.2 nvtabular-1.6.0+3.g8e7edbaf

[notice] A new release of pip available: 22.2.2 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[3] | python -m pip install --upgrade git+https://github.com/NVIDIA-Merlin/core.git
Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
Collecting git+https://github.com/NVIDIA-Merlin/core.git
Cloning https://github.com/NVIDIA-Merlin/core.git to /tmp/pip-req-build-qkubh9wx
Running command git clone --filter=blob:none --quiet https://github.com/NVIDIA-Merlin/core.git /tmp/pip-req-build-qkubh9wx
Resolved https://github.com/NVIDIA-Merlin/core.git to commit 7059e2358683b8ed746065a883e3339e02d41b1e
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'done'
Preparing metadata (pyproject.toml): started
Preparing metadata (pyproject.toml): finished with status 'done'
Requirement already satisfied: tqdm>=4.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (4.64.1)
Requirement already satisfied: packaging in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (21.3)
Requirement already satisfied: betterproto<2.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (1.2.5)
Requirement already satisfied: distributed>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+6.g7059e23) (2022.3.0)
Requirement already satisfied: pyarrow>=5.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (7.0.0)
Requirement already satisfied: fsspec==2022.5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+6.g7059e23) (2022.5.0)
Requirement already satisfied: pandas<1.4.0dev0,>=1.2.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+6.g7059e23) (1.3.5)
Requirement already satisfied: tensorflow-metadata>=1.2.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (1.10.0)
Requirement already satisfied: numba>=0.54 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+6.g7059e23) (0.55.1)
Requirement already satisfied: dask>=2022.3.0 in /var/jenkins_home/.local/lib/python3.8/site-packages (from merlin-core==0.8.0+6.g7059e23) (2022.3.0)
Requirement already satisfied: protobuf>=3.0.0 in /usr/local/lib/python3.8/dist-packages (from merlin-core==0.8.0+6.g7059e23) (3.19.5)
Requirement already satisfied: grpclib in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (0.4.3)
Requirement already satisfied: stringcase in /usr/local/lib/python3.8/dist-packages (from betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (1.2.0)
Requirement already satisfied: toolz>=0.8.2 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (0.12.0)
Requirement already satisfied: cloudpickle>=1.1.1 in /usr/local/lib/python3.8/dist-packages (from dask>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (2.2.0)
Requirement already satisfied: pyyaml>=5.3.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/PyYAML-5.4.1-py3.8-linux-x86_64.egg (from dask>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (5.4.1)
Requirement already satisfied: partd>=0.3.10 in /var/jenkins_home/.local/lib/python3.8/site-packages/partd-1.2.0-py3.8.egg (from dask>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (1.2.0)
Requirement already satisfied: click>=6.6 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (8.1.3)
Requirement already satisfied: msgpack>=0.6.0 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (1.0.4)
Requirement already satisfied: sortedcontainers!=2.0.0,!=2.0.1 in /var/jenkins_home/.local/lib/python3.8/site-packages/sortedcontainers-2.4.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (2.4.0)
Requirement already satisfied: tornado>=6.0.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/tornado-6.1-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (6.1)
Requirement already satisfied: zict>=0.1.3 in /var/jenkins_home/.local/lib/python3.8/site-packages/zict-2.0.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (2.0.0)
Requirement already satisfied: jinja2 in /usr/local/lib/python3.8/dist-packages (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (3.1.2)
Requirement already satisfied: tblib>=1.6.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/tblib-1.7.0-py3.8.egg (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (1.7.0)
Requirement already satisfied: psutil>=5.0 in /var/jenkins_home/.local/lib/python3.8/site-packages/psutil-5.8.0-py3.8-linux-x86_64.egg (from distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (5.8.0)
Requirement already satisfied: numpy<1.22,>=1.18 in /var/jenkins_home/.local/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+6.g7059e23) (1.20.3)
Requirement already satisfied: setuptools in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+6.g7059e23) (65.4.1)
Requirement already satisfied: llvmlite<0.39,>=0.38.0rc1 in ./.tox/test-gpu/lib/python3.8/site-packages (from numba>=0.54->merlin-core==0.8.0+6.g7059e23) (0.38.1)
Requirement already satisfied: pyparsing!=3.0.5,>=2.0.2 in /usr/local/lib/python3.8/dist-packages (from packaging->merlin-core==0.8.0+6.g7059e23) (3.0.9)
Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+6.g7059e23) (2.8.2)
Requirement already satisfied: pytz>=2017.3 in /usr/local/lib/python3.8/dist-packages (from pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+6.g7059e23) (2022.2.1)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+6.g7059e23) (1.52.0)
Requirement already satisfied: absl-py<2.0.0,>=0.9 in /usr/local/lib/python3.8/dist-packages (from tensorflow-metadata>=1.2.0->merlin-core==0.8.0+6.g7059e23) (1.2.0)
Requirement already satisfied: locket in /var/jenkins_home/.local/lib/python3.8/site-packages/locket-0.2.1-py3.8.egg (from partd>=0.3.10->dask>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (0.2.1)
Requirement already satisfied: six>=1.5 in /var/jenkins_home/.local/lib/python3.8/site-packages (from python-dateutil>=2.7.3->pandas<1.4.0dev0,>=1.2.0->merlin-core==0.8.0+6.g7059e23) (1.15.0)
Requirement already satisfied: heapdict in /var/jenkins_home/.local/lib/python3.8/site-packages/HeapDict-1.0.1-py3.8.egg (from zict>=0.1.3->distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (1.0.1)
Requirement already satisfied: multidict in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (6.0.2)
Requirement already satisfied: h2<5,>=3.1.0 in /usr/local/lib/python3.8/dist-packages (from grpclib->betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (4.1.0)
Requirement already satisfied: MarkupSafe>=2.0 in /usr/local/lib/python3.8/dist-packages (from jinja2->distributed>=2022.3.0->merlin-core==0.8.0+6.g7059e23) (2.1.1)
Requirement already satisfied: hyperframe<7,>=6.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (6.0.1)
Requirement already satisfied: hpack<5,>=4.0 in /usr/local/lib/python3.8/dist-packages (from h2<5,>=3.1.0->grpclib->betterproto<2.0.0->merlin-core==0.8.0+6.g7059e23) (4.0.0)
Building wheels for collected packages: merlin-core
Building wheel for merlin-core (pyproject.toml): started
Building wheel for merlin-core (pyproject.toml): finished with status 'done'
Created wheel for merlin-core: filename=merlin_core-0.8.0+6.g7059e23-py3-none-any.whl size=118560 sha256=f30c857f8ed4fb195c73fbd16541b4818c16b377b1d5ceb4074d7734eb90caad
Stored in directory: /tmp/pip-ephem-wheel-cache-xb6a0zng/wheels/c8/38/16/a6968787eafcec5fa772148af8408b089562f71af0752e8e84
Successfully built merlin-core
Installing collected packages: merlin-core
Attempting uninstall: merlin-core
Found existing installation: merlin-core 0.3.0+12.g78ecddd
Not uninstalling merlin-core at /var/jenkins_home/.local/lib/python3.8/site-packages, outside environment /var/jenkins_home/workspace/merlin_merlin/merlin/.tox/test-gpu
Can't uninstall 'merlin-core'. No files were found to uninstall.
Successfully installed merlin-core-0.8.0+6.g7059e23

[notice] A new release of pip available: 22.2.2 -> 22.3.1
[notice] To update, run: pip install --upgrade pip
test-gpu run-test: commands[4] | python -m pytest --cov-report term --cov merlin -rxs tests/unit
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-7.1.3, pluggy-1.0.0
cachedir: .tox/test-gpu/.pytest_cache
rootdir: /var/jenkins_home/workspace/merlin_merlin/merlin
plugins: anyio-3.5.0, xdist-3.0.2, cov-4.0.0
collected 3 items

tests/unit/test_version.py . [ 33%]
tests/unit/examples/test_building_deploying_multi_stage_RecSys.py . [ 66%]
tests/unit/examples/test_scaling_criteo_merlin_models.py . [100%]

---------- coverage: platform linux, python 3.8.10-final-0 -----------
Name Stmts Miss Cover

.tox/test-gpu/lib/python3.8/site-packages/merlin/core/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/compat.py 10 4 60%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/dispatch.py 355 212 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/protocols.py 100 45 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/core/utils.py 195 108 45%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/init.py 5 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/base_operator.py 122 15 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/dictarray.py 54 19 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/executors.py 141 29 79%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/graph.py 99 24 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/node.py 344 146 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/concat_columns.py 17 1 94%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/selection.py 22 1 95%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subset_columns.py 12 4 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/ops/subtraction.py 21 11 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/dag/selector.py 101 27 73%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/aliccp/dataset.py 141 102 28%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/booking/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/booking/dataset.py 107 80 25%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/ecommerce/dressipi/dataset.py 45 37 18%
.tox/test-gpu/lib/python3.8/site-packages/merlin/datasets/synthetic.py 147 56 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/csv.py 57 38 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dask.py 181 97 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_engine.py 61 38 38%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataframe_iter.py 21 2 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset.py 346 157 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/dataset_engine.py 37 8 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/fsspec_utils.py 127 108 15%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/hugectr.py 45 35 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/parquet.py 603 344 43%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/shuffle.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/worker.py 80 20 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer.py 190 78 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/io/writer_factory.py 18 5 72%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/api.py 14 5 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/config/schema.py 62 16 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/io.py 15 1 93%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/backend.py 379 113 70%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/dataframe_iter.py 21 17 19%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/tf_utils.py 57 27 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/loader/utils.py 40 15 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/init.py 70 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/cross.py 44 28 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/dlrm.py 49 8 84%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/experts.py 99 75 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/interaction.py 108 55 49%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/mlp.py 117 58 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/optimizer.py 173 127 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/base.py 169 89 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/matrix_factorization.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/retrieval/two_tower.py 30 4 87%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/base.py 29 7 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/cross_batch.py 46 31 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/in_batch.py 35 12 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/blocks/sampling/queue.py 115 99 14%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/aggregation.py 241 107 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/base.py 244 108 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/combinators.py 426 151 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/encoder.py 170 117 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/index.py 104 69 34%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/prediction.py 50 19 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/core/tabular.py 280 71 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/distributed/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/distributed/backend.py 9 2 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/base.py 60 36 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/continuous.py 39 4 90%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/inputs/embedding.py 458 154 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/loader.py 268 148 45%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/init.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/base.py 9 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/listwise.py 13 1 92%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/losses/pairwise.py 115 57 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/metrics/topk.py 198 82 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/base.py 751 337 55%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/benchmark.py 16 6 62%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/ranking.py 67 43 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/retrieval.py 78 44 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/models/utils.py 10 2 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/base.py 122 89 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/classification.py 91 51 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/contrastive.py 147 107 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/regression.py 9 2 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/base.py 78 41 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/in_batch.py 37 22 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/sampling/popularity.py 27 17 37%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/outputs/topk.py 97 62 36%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/base.py 207 108 48%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/classification.py 68 22 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/multi.py 7 1 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/next_item.py 59 33 44%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/regression.py 35 19 46%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/prediction_tasks/retrieval.py 73 31 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/block.py 101 54 47%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transformers/transforms.py 63 14 78%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/bias.py 111 77 31%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/features.py 435 346 20%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/noise.py 43 28 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/regularization.py 17 6 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/sequence.py 282 212 25%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/transforms/tensor.py 158 75 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/typing.py 7 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/batch_utils.py 85 12 86%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/repr_utils.py 69 48 30%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/search_utils.py 34 22 35%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/tf/utils/tf_utils.py 209 141 33%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/constants.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dataset.py 38 18 53%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/dependencies.py 26 19 27%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/doc_utils.py 10 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/example_utils.py 31 10 68%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/misc_utils.py 118 90 24%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/nvt_utils.py 27 24 11%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/registry.py 101 31 69%
.tox/test-gpu/lib/python3.8/site-packages/merlin/models/utils/schema_utils.py 90 39 57%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/init.py 2 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/proto_utils.py 20 4 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/schema_bp.py 306 7 98%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/io/tensorflow_metadata.py 190 34 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/schema.py 209 53 75%
.tox/test-gpu/lib/python3.8/site-packages/merlin/schema/tags.py 82 6 93%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/init.py 6 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/_version.py 4 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/init.py 3 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ensemble.py 46 20 57%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/node.py 23 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/op_runner.py 26 1 96%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/init.py 9 4 56%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/compat.py 24 8 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/faiss.py 77 27 65%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/feast.py 126 53 58%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/operator.py 79 32 59%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/softmax_sampling.py 51 12 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/tensorflow.py 67 22 67%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/unroll_features.py 50 12 76%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/ops/workflow.py 72 26 64%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/init.py 1 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/base_runtime.py 11 2 82%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/triton/init.py 1 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/triton/ops/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/triton/ops/operator.py 11 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/triton/ops/tensorflow.py 61 12 80%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/dag/runtimes/triton/runtime.py 140 47 66%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/model_registry.py 16 8 50%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/init.py 47 12 74%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/conversions.py 87 51 41%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/export.py 268 210 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/models/init.py 0 0 100%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/triton/utils.py 72 14 81%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/init.py 22 20 9%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/base.py 113 14 88%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/hugectr.py 37 29 22%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/pytorch.py 10 6 40%
.tox/test-gpu/lib/python3.8/site-packages/merlin/systems/workflow/tensorflow.py 32 13 59%

TOTAL 14703 6864 53%

======================== 3 passed in 337.33s (0:05:37) =========================
/usr/local/lib/python3.8/dist-packages/coverage/inorout.py:519: CoverageWarning: Module merlin was never imported. (module-not-imported)
self.warn(f"Module {pkg} was never imported.", slug="module-not-imported")
/usr/local/lib/python3.8/dist-packages/coverage/control.py:801: CoverageWarning: No data was collected. (no-data-collected)
self._warn("No data was collected.", slug="no-data-collected")
___________________________________ summary ____________________________________
test-gpu: commands succeeded
congratulations :)
Performing Post build task...
Match found for : : True
Logical operation result is TRUE
Running script : #!/bin/bash
cd /var/jenkins_home/
CUDA_VISIBLE_DEVICES=1 python test_res_push.py "https://github.com/gitapi/repos/NVIDIA-Merlin/Merlin/issues/$ghprbPullId/comments" "/var/jenkins_home/jobs/$JOB_NAME/builds/$BUILD_NUMBER/log"
[merlin_merlin] $ /bin/bash /tmp/jenkins4678550819482235409.sh

@edknv edknv added the ci label Nov 7, 2022
@edknv edknv marked this pull request as ready for review November 7, 2022 18:40
Copy link
Member

@mikemckiernan mikemckiernan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If the tests pass, and on the first try, that's the biggest vote of confidence we can get. Huge thanks.

@edknv edknv merged commit 24a63bc into NVIDIA-Merlin:main Nov 7, 2022
karlhigley added a commit to karlhigley/NVTabular that referenced this pull request Nov 18, 2022
karlhigley added a commit to karlhigley/NVTabular that referenced this pull request Nov 18, 2022
karlhigley added a commit to NVIDIA-Merlin/NVTabular that referenced this pull request Nov 19, 2022
* Update metrics keys in example notebook tests

* Test against the latest version of Merlin Models

* Allow `tox` tasks to use the `OPAL_PREFIX` env variable

Following @edknv's work in NVIDIA-Merlin/Merlin#724

* Allow `tox` tasks to use the `NR_USER` env variable
edknv pushed a commit to edknv/NVTabular that referenced this pull request Nov 19, 2022
* Update metrics keys in example notebook tests

* Test against the latest version of Merlin Models

* Allow `tox` tasks to use the `OPAL_PREFIX` env variable

Following @edknv's work in NVIDIA-Merlin/Merlin#724

* Allow `tox` tasks to use the `NR_USER` env variable
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants