About BatchNormalization

[RainPot]

hi
by running your project,I can reach high mIoU,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%,why is that?

[RainPot]

thanks for great code btw

[sonack]

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

[RainPot]

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

DeepLab-v3-plus-cityscapes/models/resnet.py

Line 51 in e31cc75

self.bn3 = nn.BatchNorm2d(out_chan)

[sonack]

@Cynicsss How did you control the BN sync or not sync? I found the bn in resnet is original all sync already? What do you mean by ,but when the Batchnormlization is setting all SYNC in ResNet,the mIoU can just reach 70%

DeepLab-v3-plus-cityscapes/models/resnet.py

Line 51 in e31cc75

self.bn3 = nn.BatchNorm2d(out_chan)

Do you know why the author need to use the original nn.BatchNorm2drather than synced bn here ?

[codermckee]

@Cynicsss Hi, how long did it take you to reach 70% mIoU? I tried the code, but it takes one night just training about 12000 iterations.

[codermckee]

@Cynicsss I use 3 *1080ti to train on CityScapes without any change, but just reaching 70.23% mIoU. Is there something I should change in order to reach higher mIoU? BTW, it costed me about 2.5 days to train 41000 iterations..so sad.

[LetsGoFir]

@Cynicsss I use 3 *1080ti to train on CityScapes without any change, but just reaching 70.23% mIoU. Is there something I should change in order to reach higher mIoU? BTW, it costed me about 2.5 days to train 41000 iterations..so sad.

It takes me 4 hours to train 15000 iterations with 2 RTX2080 and finally I got 78.2 mIoU.

[prachigarg23]

@LetsGoFir can you please confirm if this repository is reproducible for cityscapes? I'm also using 2RTX 2080 GPUs and facing issues getting 75%+ mIoU on CS. Also any idea if there are any differences between this implementation and the official implementation?