22.10

What’s Changed

• Remove nvtabular backend @jperez999 (#378)
• Adding instructions for running the E2E example on CPU @AshishSardana (#332)
• add fastai to torch dockerfile @jperez999 (#363)
• Fail the build if tritonserver is missing from inference containers @benfred (#358)
• Use python setup.py install to install SOK @jperez999 (#357)
• hugectr dockerfile update @jperez999 (#355)
• Add sparse operation kit and distributed embeddings to tf image @jperez999 (#354)
• Update hugectr and torch dockerfiles @jperez999 (#353)
• Update merlin base dockerfile for 22.05 @jperez999 (#348)
• Update Arrow and triton versions @jperez999 (#347)
• Sys tests fix @jperez999 (#342)
• add Tf keras to dockerfile @jperez999 (#341)
• Fix ci routes @jperez999 (#331)
• Ci update @jperez999 (#337)
• Update CI dockerfile with new cuda keyring and keys for repo @jperez999 (#334)
• Fix CVE @jperez999 (#328)
• Distributed embeddings failing to install because of PYTHONPATH Edit before hand @jperez999 (#326)
• Fix for 'import error' in merlin-tensorflow-training:22.05 @EmmaQiaoCh (#317)
• Merlin rm bad key @jperez999 (#316)
• Merlin rm bad key @jperez999 (#314)
• Remove bad key for Nvidia apt repositories @jperez999 (#311)
• Add torch inf @jperez999 (#307)
• Add torch inf @jperez999 (#305)
• Remove merlin PYTHONPATH edits @jperez999 (#304)
• remove horovod upgrade to fix tf perf issue @zehuanw (#302)
• Add container infos to notebooks @bschifferer (#298)
• Rm pip e @jperez999 (#300)

⚠ Breaking Changes

• Update for change of hugectr branch name @EmmaQiaoCh (#705)
• Fix ci order @jperez999 (#581)
• Fix int test @jperez999 (#578)
• Add numpy anchor version after all package building and updates @jperez999 (#566)
• Fix unit scaling criteo inference serving @jperez999 (#559)
• Moving loss and metrics to model.compile @oliverholworthy (#340)

🐜 Bug Fixes

• adding dataloader repo to dockerfile @jperez999 (#722)
• add in reinstall for dask and distributed after feast install @jperez999 (#713)
• create resilient directory rm @jperez999 (#718)
• fix missing lib issue by adding from upstream @jperez999 (#689)
• get numba from upstream container @jperez999 (#690)
• Adding git pull command to nightly docker to ensure latest commit @jperez999 (#617)
• Fix unit scaling criteo inference serving @jperez999 (#559)
• Fix integration test and update NB @radekosmulski (#544)
• Fix nightly container builds @benfred (#518)
• Fix typo in CI script file name @karlhigley (#445)
• remove extra CMD from containers @jperez999 (#390)
• Add pytorch tritonserver backend to ci dockerfile @jperez999 (#441)
• updates from entrypoint and cupy cuda116 @jperez999 (#389)
• Add matplotlib to torch container @jperez999 (#386)
• Add nvt backend back into containers @jperez999 (#382)
• Remove entrypoint from inference/training images. @oliverholworthy (#336)
• fix: "illegal instruction" error in hugectr test jobs @EmmaQiaoCh (#295)

🚀 Features

• Add Dropna to remove nulls in the dataset that creates error in the integration test of multi-stage deployment nb @rnyak (#629)
• Update multi-stage deployment notebooks and integration test @rnyak (#627)
• modify multi-stage deployment nbs wrt recent changes in systems  @rnyak (#621)
• Changes for hugectr @EmmaQiaoCh (#502)
• fixes in the PoC first notebook @rnyak (#487)
• Switch over HDFS build/install scripts @bashimao (#434)
• Add jupyter ENVs in case launching container with normal user @EmmaQiaoCh (#439)
• fix poc nbs and move poc unit test @rnyak (#387)
• Moving loss and metrics to model.compile @oliverholworthy (#340)

📄 Documentation

• docs: semver to calver banner @mikemckiernan (#715)
• docs: Add configuration for SEO @mikemckiernan (#723)
• docs: Remove SM from the support matrix @mikemckiernan (#721)
• Support matrix updates for 22.10 @nvidia-merlin-bot (#719)
• fix: Update HugeCTR version to 4.1.1 @mikemckiernan (#717)
• Support matrix updates for 22.09 @nvidia-merlin-bot (#711)
• Support matrix updates for 22.10 @nvidia-merlin-bot (#710)
• fix links in Multi-stage Bulding-and-deployment nbs @rnyak (#697)
• Support matrix updates for 22.09 @nvidia-merlin-bot (#636)
• Address virtual dev review comments @mikemckiernan (#626)
• modify multi-stage deployment nbs wrt recent changes in systems  @rnyak (#621)
• Add a "New Functionality" section to the Roadmap issue template @karlhigley (#596)
• Update Logos of all examples @bschifferer (#569)
• Update Merlin libs graphic @mikemckiernan (#560)
• Support matrix updates for 22.06 @nvidia-merlin-bot (#500)
• Support matrix updates for 22.07 @nvidia-merlin-bot (#499)
• Get TF version from Python and not Pip @mikemckiernan (#498)
• docs: Readability improvements @ryanrussell (#440)
• Update Criteo Example with Merlin Models and Merlin Systems @rvk007 (#380)
• fixes in the PoC first notebook @rnyak (#487)
• Remove unnecessary dependencies from docs builds @mikemckiernan (#466)
• add integration tests @radekosmulski (#310)
• Update README with installation steps @rvk007 (#430)
• Support matrix updates for 22.06 @nvidia-merlin-bot (#435)
• Add NGC overview descriptions for our containers @benfred (#399)
• Add run timestamp to data @mikemckiernan (#415)
• Update URLs for Criteo dataset @mikemckiernan (#400)
• Document the change to three containers @mikemckiernan (#379)
• fix poc nbs and move poc unit test @rnyak (#387)
• Add issue templates @karlhigley (#345)
• Hand-edit the HugeCTR versions @mikemckiernan (#329)
• Support matrix updates for 22.05 @nvidia-merlin-bot (#321)
• chore: Add release-drafter @mikemckiernan (#308)

🔧 Maintenance

• adding in instructions from the jenkins dockerfile to keep in one place @jperez999 (#725)
• Pass mpi environment variable to tox @edknv (#724)
• adding dataloader repo to dockerfile @jperez999 (#722)
• docs: Add two projects to the support matrix @mikemckiernan (#720)
• add in reinstall for dask and distributed after feast install @jperez999 (#713)
• create resilient directory rm @jperez999 (#718)
• Install horovod in the ci-runner image for CI testing @edknv (#712)
• Update for change of hugectr branch name @EmmaQiaoCh (#705)
• Add dist-info directories for packages copied in the tensorflow image. @oliverholworthy (#704)
• revert change from 2209 requirements @jperez999 (#701)
• revert to 22.08 @jperez999 (#698)
• add llvmlite to base for numba dep @jperez999 (#691)
• fix missing lib issue by adding from upstream @jperez999 (#689)
• get numba from upstream container @jperez999 (#690)
• update TFDE build @FDecaYed (#659)
• Upgrade upstream container references, get pyarrow from upstream @jperez999 (#656)
• fix: RMM and cuDF are no longer installed with pip @mikemckiernan (#637)
• Adding hugectr to nightly build dockerfile @jperez999 (#632)
• Increase timeout of unit test for second multi-stage notebook @oliverholworthy (#630)
• Add Dropna to remove nulls in the dataset that creates error in the integration test of multi-stage deployment nb @rnyak (#629)
• Enable unittest for 2stage notebooks @bschifferer (#628)
• Update paths using BASE_DIR in multi-stage notebook to handle non-default value @oliverholworthy (#622)
• Update multi-stage deployment notebooks and integration test @rnyak (#627)
• anchor tf version to avoid errors in 2.10.0 libnvinfer look ups @jperez999 (#625)
• Revert to working tritonserver call in notebook using testbooks @jperez999 (#619)
• Remove lint env from tox config @karlhigley (#624)
• Add a tox config file @karlhigley (#623)
• Update ci container to use nightly base container @jperez999 (#620)
• Adding git pull command to nightly docker to ensure latest commit @jperez999 (#617)
• Add dock nite @jperez999 (#616)
• Add dockerfile for nightly builds @jperez999 (#615)
• Args mv @jperez999 (#603)
• Args mv @jperez999 (#602)
• anchor Tf version @jperez999 (#601)
• Add a "New Functionality" section to the Roadmap issue template @karlhigley (#596)
• Don't install faiss with the integration tests @benfred (#591)
• Install numpy for building faiss @benfred (#590)
• Fixes for faiss install @benfred (#587)
• Include a SM80 enabled version of faiss on merlin-base container @benfred (#584)
• Rearrange testing for faster feedback @jperez999 (#583)
• Second fix @jperez999 (#582)
• Update triage github actions workflow @benfred (#580)
• Fix ci order @jperez999 (#581)
• Reduce the size of synthetic data used in Criteo test @karlhigley (#579)
• Fix int test @jperez999 (#578)
• Fix int + unit tests @jperez999 (#577)
• Add hadoop envs @EmmaQiaoCh (#565)
• Add numpy anchor version after all package building and updates @jperez999 (#566)
• Docker edit @jperez999 (#564)
• Docker fix @jperez999 (#563)
• Add skip tf crit unit @jperez999 (#561)
• Fix unit scaling criteo inference serving @jperez999 (#559)
• update base dockerfile @benfred (#556)
• Update the Merlin repos in the CI image build @karlhigley (#558)
• Remove dependencies of hugectr & install hps tf plugin to merlin-tf @EmmaQiaoCh (#549)
• Skip the multi-stage example notebook (for now) @karlhigley (#543)
• Skip multi-stage example integration test (for now) @karlhigley (#541)
• Revert CMake changes @karlhigley (#538)
• Install CMake in Merlin base image (instead of copying from build) @karlhigley (#524)
• Mark "scaling Criteo" notebook to be skipped without TF @karlhigley (#537)
• install tox in base image @nv-alaiacano (#532)
• Pin fsspec==22.5.0 directly in the Merlin base image @karlhigley (#533)
• Remove duplicate CMake installs @karlhigley (#523)
• Make integration test script executable @karlhigley (#521)
• Install Feast/Faiss before running Merlin integration tests @karlhigley (#520)
• Downgrade onnxruntime due to security issue of mpmath @EmmaQiaoCh (#486)
• Convert the default text in the roadmap issue template to comments @karlhigley (#483)
• Add tests in the Merlin repo to the CI test scripts @karlhigley (#450)
• Remove unnecessary dependencies from docs builds @mikemckiernan (#466)
• Adds integration tests to Merlin Models @gabrielspmoreira (#438)
• Add wandb @jperez999 (#470)
• added fiddle to container for models testing @jperez999 (#469)
• add integration tests @radekosmulski (#310)
• Refactor the container test script to run all the SW checks, unit tests, or integration tests before failing @karlhigley (#444)
• Switch over HDFS build/install scripts @bashimao (#434)
• remove extra CMD from containers @jperez999 (#390)
• Add pytorch tritonserver backend to ci dockerfile @jperez999 (#441)
• Add jupyter ENVs in case launching container with normal user @EmmaQiaoCh (#439)
• remove excess python path setting @jperez999 (#432)
• Remove stale doc reviews @mikemckiernan (#417)
• Fix failing treelite install @jperez999 (#416)
• Add FIL support to Base container, Add e2e support in ci container @jperez999 (#414)
• Always run NVT integration tests @benfred (#401)
• Inline hugectr container tests @benfred (#398)
• Update test_container.sh script @benfred (#396)
• Restrict tritonclient to 2.22.0 @EmmaQiaoCh (#391)
• Add sok test new @EmmaQiaoCh (#384)
• Add skip checks to examples tests @jperez999 (#392)
• updates from entrypoint and cupy cuda116 @jperez999 (#389)
• Add matplotlib to torch container @jperez999 (#386)
• Rm old docker @jperez999 (#383)
• Add a GA workflow that requires labels on PR's @benfred (#381)
• Support matrix updates for 22.05 @nvidia-merlin-bot (#352)
• Support matrix updates for 21.11 @nvidia-merlin-bot (#372)
• Support matrix updates for 21.09 @nvidia-merlin-bot (#373)
• Support matrix updates for 22.03 @nvidia-merlin-bot (#368)
• Support matrix updates for 22.02 @nvidia-merlin-bot (#370)
• Support matrix updates for 22.01 @nvidia-merlin-bot (#369)
• Support matrix updates for 21.12 @nvidia-merlin-bot (#371)
• Refactor SMX for blossom @mikemckiernan (#351)
• Support matrix updates for 22.04 @nvidia-merlin-bot (#367)
• Update for hdfs @EmmaQiaoCh (#365)
• Enable running the SMX data job in Blossom @mikemckiernan (#325)
• Request that PRs are labeled @mikemckiernan (#327)
• Also use horovod from DLFW for hugectr training container @benfred (#303)