I don't mind someone speaking in another language in a private conversation. If I'm not involved in the conversation, then it doesn't matter that I don't understand them. The thing I hate is when someone starts to speak to me in foreign language and after I tell I don't speak that language, they start to speak to me in perfect English. If I go to another country, I don't assume everyone speaks English.