It is not seething... it is disappointment.
Before and at the beginning of the duel he is mainly enthusiastic to finally meet his son. When he disarms him and reveals the fact that he is his father he is excited and hyped up. After Luke turns him down he is utterly disappointed.
It is very natural in terms of father/son aspect. I see no reason what-so-ever for anger in this situation.