🚨 fix(SigLip): remove spurious exclusion of first vision output token (…

…huggingface#30952)

fix(SigLip): remove spurious exclusion of first vision output token in classifier

src/transformers/models/siglip/modeling_siglip.py

@@ -1527,7 +1527,7 @@ def forward(
         sequence_output = outputs[0]
 
         # average pool the patch tokens
-        sequence_output = torch.mean(sequence_output[:, 1:, :], dim=1)
+        sequence_output = torch.mean(sequence_output, dim=1)
         # apply classifier
         logits = self.classifier(sequence_output)