add LongNet and LongViT in README

microsoft · Dec 20, 2023 · 64be2f0 · 64be2f0
1 parent 8e7e6eb
commit 64be2f0
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -20,6 +20,7 @@ Fundamental research to develop new architectures for foundation models and A(G)
 
 ## News
 
+- December, 2023: [LongNet](torchscale/model/LongNet.py) and [LongViT](examples/longvit/README.md) released
 - October, 2023: Update RMSNorm and SwiGLU as the default module in RetNet
 - November, 2022: TorchScale 0.1.1 released [[Paper](https://arxiv.org/abs/2211.13184)] [[PyPI](https://pypi.org/project/torchscale/)]
 
@@ -142,6 +143,8 @@ We have examples of how to use TorchScale in the following scenarios/tasks:
 
 - Vision
 
+  * [LongViT](examples/longvit/README.md)
+
   * ViT/BEiT [In progress]
 
 - Speech