Why not? Exactly because there is nothing tethering our axioms on paper to what is necessarily true. You could formulate something wildly different from ZF±C/Peano/whatever normal axiom system, but we wouldn't call it "math", and what we currently call "math" will work under any conditions
Our 'math' will work under any of our conditions (as far as we can observe), but who's to say they can't have 'math' in another universe that will work under any of their conditions, yet still be different from ours?
That's what GP was saying ("there are no conceivable alternate universes with different math", and none with a different derivative in particular), but I see no reason why math-as-we-know-it couldn't just be inapplicable to different 'conceivable' universes.
