Training loss(es) during pre-training

[afilt]

Hello,
I was wondering if you could provide additional details on the evolution of loss functions during the pre-training of UNI.
It has indeed been observed that instabilities or convergence issues may hinder the pre-training. Is this something you already observed ?

Congratulations for this groundbreaking work and for publicly releasing weights.