Skip to content

SparseML v0.4.0
Compare
Choose a tag to compare
@jeanniefinks jeanniefinks released this 04 Jun 20:52
v0.4.0
f2e2a37
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

New Features:

  • M-FAC/Woodfisher pruning algorithm alpha implemented.
  • Movement pruning algorithm alpha implemented.
  • Distillation code added for GLUE dataset in Hugging Face/transformers integration.
  • BERT quantization pipeline enabled for training and export to ONNX.

Changes:

  • Readme redesigned for better clarity on the repository's purpose.
  • All examples, notebooks, and scripts moved under the integrations directory.
  • Integrations for ultralytics/yolov3, ultralytics/yolov5, pytorch, keras, tensorflow reworked to match new integrations standards for better ease of use.

Resolved Issues:

  • rwightman/timm integration bugs dealing with checkpoint paths and loading models addressed.
  • tensorflow-gpu for tensorflow v1 now recognized correctly.
  • Neural Magic dependencies upgrade to intended bug versions instead of minor versions.

Known Issues:

  • Movement pruning is currently only working with FP16 training on GPUs, FP32 is diverging to NaN.
Assets 3
Loading