3rd Party Vision Transformer Weights

A catch-all (ish) release for storing vision transformer weights adapted/rehosted from 3rd parties. Too many incoming models for one release per source...

Containing weights from:

• Twins - https://github.com/Meituan-AutoML/Twins
• Visformer - danczs/Visformer#2
• NesT (Aggregated Nested Transformer) - weights converted from https://github.com/google-research/nested-transformer by @alexander-soare ' script

v0.4.9. EfficientNetV2. MLP-Mixer. ResNet-RS. More vision transformers.

Fix drop/drop_path arg on MLP-Mixer model. Fix #641

EfficientNet-V2 weights ported from Tensorflow impl

Weights from https://github.com/google/automl/tree/master/efficientnetv2

Paper: EfficientNetV2: Smaller Models and Faster Training - https://arxiv.org/abs/2104.00298

ResNet-RS weights

Weights for ResNet-RS models as per #554 . Ported from Tensorflow impl (https://github.com/tensorflow/tpu/tree/master/models/official/resnet/resnet_rs) by @amaarora

Weights for CoaT (vision transformer) models

Weights for CoaT: Co-Scale Conv-Attentional Image Transformers (from https://github.com/mlpc-ucsd/CoaT)

Weights for PiT (Pooling-based Vision Transformer) models

Weights from https://github.com/naver-ai/pit

Copyright 2021-present NAVER Corp.

Rehosted here for easy pytorch hub downloads.

v0.4.5. Lots of models. NFNets (& NF-ResNet, NF-RegNet), GPU-Efficient Nets, RepVGG, VGG.

Merge pull request #475 from rwightman/pre-release/0.4.5

Prep for PyPi release. Tweak NFNet, ResNetV2, RexNet feature extraction, use pre-act features. Also, add act args to RexNet #202

DeepMind NFNet-F* weights

Weights converted from DeepMind Haiku impl of NFNets (https://github.com/deepmind/deepmind-research/tree/master/nfnets)

RepVGG checkpoints remapped from official repo

Checkpoints remapped from official repository at https://github.com/DingXiaoH/RepVGG

GPU-Efficient (Residual) Networks checkpoints

Checkpoints remapped from official repo at https://github.com/idstcv/GPU-Efficient-Networks