Bad results when evaluating pretrained checkpoints

[huangzhengxiang]

Hi. Thanks for your great work.
I followed your instructions in README.md to extract nuscenes dataset.
I ran evaluate.py with official pretrained checkpoint (https://github.com/wayveai/fiery/releases/download/v1.0/fiery.ckpt) but got the output as follows:
iou
53.5 & 28.6
pq
39.8 & 18.0
sq
69.4 & 66.3
rq
57.4 & 27.1
Is there something wrong? It seems to be much lower than the results you got.

[gaohao-dev]

Hi. Thanks for your great work. I followed your instructions in README.md to extract nuscenes dataset. I ran evaluate.py with official pretrained checkpoint (https://github.com/wayveai/fiery/releases/download/v1.0/fiery.ckpt) but got the output as follows: iou 53.5 & 28.6 pq 39.8 & 18.0 sq 69.4 & 66.3 rq 57.4 & 27.1 Is there something wrong? It seems to be much lower than the results you got.

I meet the same problem with you. Have you solved it?