This statement is actually very insensitive, offensive to women indeed. It’s the closest to profanity that I can think of.
And “what is wrong with that?” If you can’t see what is wrong with that, than there is probably no future for this conversations because you are clearly declaring that you cannot see any problem with discrimination of women.
Therefore, not much more can be discussed on the issue. Until discriminators open their minds and see what is wrong with discrimination of women, they will keep asking the same question over and over again, “What is wrong with that.”