Dyscalculiaphobia is the fear of dyscalculia, which is a specific learning disability related to numbers and arithmetic.
Fear of dyscalculia