Add an exclude patttern for wheels (and use it for flit-core)

Add an exclude patttern for wheels (and use it for flit-core) #475