MMRazor Release V1.0.0rc2

Changelog of v1.0.0rc2

v1.0.0rc2 (06/01/2022)

We are excited to announce the release of MMRazor 1.0.0rc2.

New Features

NAS

• Add Performance Predictor: Support 4 performance predictors with 4 basic machine learning algorithms, which can be used to directly predict model accuracy without evaluation.(#306)

• Support Autoformer, a one-shot architecture search algorithm dedicated to vision transformer search.(#315 )

• Support BigNAS, a NAS algorithm which searches the following items in MobileNetV3 with the one-shot paradigm: kernel_sizes, out_channels, expand_ratios, block_depth and input sizes. (#219 )

Pruning

• Support DCFF, a filter channel pruning algorithm dedicated to efficient image classification.(#295)

• We release a powerfull tool to automatically analyze channel dependency, named ChannelAnalyzer. Here is an example as shown below.(#371)

Now, ChannelAnalyzer supports most of CNN models in torchvision, mmcls, mmseg and mmdet. We will continue to support more models.

from mmrazor.models.task_modules import ChannelAnalyzer
from mmengine.hub import get_model
import json

model = get_model('mmdet::retinanet/retinanet_r18_fpn_1x_coco.py')
unit_configs: dict = ChannelAnalyzer().analyze(model)
unit_config0 = list(unit_configs.values())[0]
print(json.dumps(unit_config0, indent=4))
# # short version of the config
# {
#     "channels": {
#         "input_related": [
#             {"name": "backbone.layer2.0.bn1"},
#             {“name": "backbone.layer2.0.conv2"}
#         ],
#         "output_related": [
#             {"name": "backbone.layer2.0.conv1"},
#             {"name": "backbone.layer2.0.bn1"}
#         ]
#     },
#}

KD

• Support MGD, a detection distillation algorithm.(#381)

Bug Fixes

• Fix FpnTeacherDistll techer forward from backbone + neck + head to backbone + neck(#387 )
• Fix some expire configs and checkpoints(#373 #372 #422 )

Ongoing Changes

We will release Quantization in next version(1.0.0rc3)!

Contributors

A total of 11 developers contributed to this release: @wutongshenqiu @sunnyxiaohu @aptsunny @humu789 @TinyTigerPan @FreakieHuang @LKJacky @wilxy @gaoyang07 @spynccat @yivona08.

New Contributors

• @TinyTigerPan @yivona08 made their first contribution in (#356) (#388)