I know the cast jokingly called him "Darth Farmer", but he still had to say the lines to give the actors something to play of off. The physicality is just as important to a character as dialog, as Peter Mayhew always proved.
I don't recall anybody around here being happy about Hayden in the Vader suit back in 2005. ;)