a100-pcie.md

New Result

Comparison single A100-PCIE-40GB gpu
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double

Comparison multi gpu ( using 2 A100-PCIE-40GB gpus)
Total(train)
Half	Single	Double
Total(inference)
Half	Single	Double
densenet(train)
Half	Single	Double
densenet(inference)
Half	Single	Double
vgg(train)
Half	Single	Double
vgg(inference)
Half	Single	Double
squeezenet(train)
Half	Single	Double
squeezenet(inference)
Half	Single	Double
shufflenetv2(train)
Half	Single	Double
shufflenetv2(inference)
Half	Single	Double
resnet(train)
Half	Single	Double
resnet(inference)
Half	Single	Double
mobilenet(train)
Half	Single	Double
mobilenet(inference)
Half	Single	Double
mnasnet(train)
Half	Single	Double
mnasnet(inference)
Half	Single	Double