It certainly feels like mathematics is better about leaky abstractions. It gets a lot more slack though because it's interpreted by mathematicians which can plug the leaks.

For example, there's multiple formal definitions of integrals. They aren't strictly equivalent! But when we calculate an integral, we don't concern ourselves with the differences unless they are relevant.