Frink just explained it to you. The fact that retard is interchangeable as an insult with stupid and idiot is what makes it offensive. You’re basically calling mentally retarded people stupid idiots.
The problem being that nobody I know calls them mentally retarded. It’s a dated term. Perhaps older generations, or legal documents, or people in certain regions still use it, but it is fast falling into complete disuse.