Actually the semantics of mathematics is exactly at the heart of the debate. It is what we are generally taught. Ultimately that's what the whole debate boils down to.
Another example... In the automotive realm, 2+2 means something completely different than a 4 seater. It generally means 2 actual seats, and a glorified package shelf behind those 2 seats.