Sphere-faceloss  

I changed the loss of the original lenet5 handwirtten Network:softmax loss.I use the Sphere-faceloss replace of it.

I havenot finished my training,I only trained 260 steps as fllows,and tha acc on test data is growing up to 93.75%.It is very fast.


step is  0 acc is  0.14453125
step is  10 acc is  0.296875
step is  20 acc is  0.28515625
step is  30 acc is  0.4453125
step is  40 acc is  0.5625
step is  50 acc is  0.60546875
step is  60 acc is  0.6171875
step is  70 acc is  0.63671875
step is  80 acc is  0.734375
step is  90 acc is  0.77734375
step is  100 acc is  0.828125
step is  110 acc is  0.859375
step is  120 acc is  0.86328125
step is  130 acc is  0.8984375
step is  140 acc is  0.89453125
step is  150 acc is  0.89453125
step is  160 acc is  0.90625
step is  170 acc is  0.92578125
step is  180 acc is  0.92578125
step is  190 acc is  0.91796875
step is  200 acc is  0.8984375
step is  210 acc is  0.921875
step is  220 acc is  0.89453125
step is  230 acc is  0.91796875
step is  240 acc is  0.9296875
step is  250 acc is  0.9296875
step is  260 acc is  0.9375