Easy-to-read implementation of self-supervised learning using vision transformer and knowledge distillation with no labels - DINO 😃
knowledge-distillation
feature-learning
ema
dino
self-supervised
attention-visualization
contrastive-learning
vision-transformer
feature-representation
teacher-student-training
-
Updated
Jun 27, 2023 - Python