Skip to content

Swin Transformer V2 (CR) weights and experiments

Compare
Choose a tag to compare
@rwightman rwightman released this 03 Apr 22:14
v0.1-weights-swinv2
83d7a11

This release holds weights for timm's variant of Swin V2 (from @ChristophReich1996 impl, https://github.com/ChristophReich1996/Swin-Transformer-V2)

NOTE: ns variants of the models have extra norms on the main branch at the end of each stage, this seems to help training. The current small model is not using this, but currently training one. Will have a non-ns tiny soon as well as a comparsion. in21k and 1k base models are also in the works...

small checkpoints trained on TPU-VM instances via the TPU-Research Cloud (https://sites.research.google/trc/about/)

  • swin_v2_tiny_ns_224 - 81.80 top-1
  • swin_v2_small_224 - 83.13 top-1
  • swin_v2_small_ns_224 - 83.5 top-1

Contributors

ChristophReich1996
Assets 5
Loading