I guess he is masking his true appearance up until a later point then. "I don't mind if you don't like my manners. I don't like them myself. They're pretty bad. I grieve over them during the long winter evenings."
No he's using the Force to mask his true appearance. His old master, Darth Plagueis, discovered a method to control midichlorians and create life. At least, this is all according to ROTS spoilers. I believe they are true.
Anyway there is a 20 year difference (or something like that) between III and VI, so the difference in appearance will either be explained off as aging over time or something else...the movie's not even out yet, I believe it will be explained at some point. Hopefully.