Releases: jrzaurin/pytorch-widedeep
Releases · jrzaurin/pytorch-widedeep
Patch to limit numpy to version lower than 2.0
Huggingface integration, multi-text and image column support and multi target loss functions
What's Changed
- Huggingface integration by @jrzaurin in #209
- Multi text and image column support by @jrzaurin in #215
- Support for multi target loss functions by @jrzaurin in #215
- README has been almost completely re-written, with drawings of 7 possible architectures (where the boxes/component can be any of the models in the library) and fully runnable examples with a toy dataset that anyone can use as a starting point.
Full Changelog: v1.5.1...v1.6.0
Model Attributes named correctly
Mostly fixed issue #204
Embedding Methods for Numerical Features
Added two new embedding methods for numerical features described in On Embeddings for Numerical Features in Tabular Deep Learning and adjusted all models and functionalities accordingly
The `load_from_folder` module
This release mainly adds the functionality to be able to deal with large datasets via the load_from_folder
module.
This module is inspired by the ImageFolder
class in the torchvision
library but adapted to the needs of our library. See the docs for details.
Flash and Linear Attention mechanisms added to the TabTransformer
- Added Flash Attention
- Added Linear Attention
- Revisited and polished the docs
pytorch-widedeep in the context of recsys
- Added example scripts and notebooks on how to use the library in the context of recommendation systems using this notebook as example. This is a response to issue #133
- Used the opportunity to add the movielens 100k dataset to the library, so that now it can be imported from the datasets module
- Added a simple (not pre-trained) transformer model to to the text component
- Added citation file
- Fix a bug regarding the padding index not being 1 when using the fastai transforms
Feature Importance via attention weights
- Added a new functionality to access feature importance via attention weights for all DL models for Tabular data except for the
TabPerceiver
. This functionality is accessed via thefeature_importance
attribute in the trainer (computed during training with a sample of observations) and at predict time via deexplain
method. - Fix all restore weights capabilities in all forms of training. Such capabilities are present in two callbacks, the
EarlyStopping
and theModelCheckpoint
Callbacks. Prior to this release there was a bug and the weights were not restored.
pytorch-widedeep: A flexible package for multimodal-deep-learning
joss_paper_package_version_v1.2.0 Added citations file
HuggingFace model example and fixed bug related to the option of adding a FC head
- Fixed a bug related to the option of adding a FC head on top of the "backbone" models
- Added a notebook to illustrate how one could use a Hugginface model along with any other model in the library