I guess it depends on the nature of the rejection and how “persistent” the asker is.
Of course, it’s all situational. I think we get a little too carried away in modern times as to what’s appropriate behavior.
Just because there’s no direct physical or psychological harm doesn’t make it okay though. Harassment doesn’t require those things. Consistent unwanted advances would qualify.
Perhaps, again it depends on the situation.