I say we all use 100% of our brains, including idiot savants.
They just have areas that are more developed than others, such as math or music or whatever area it is that would deal with it.
Ours is considered more normal or average, because we can function socially as well as doing tasks like math.
For what idiot savants have in special talents, they are compensated for in lacking other important skills.