I personally like to go with the idea that Palpatine isn't very old -- only in his sixties or so -- and only looks the way he does because the ravages of the dark side have eaten away at his body and made him look far, far older.
Of course, I do also go with the idea that he's used up countless clone bodies over the decades, so he actually could be very old in my canon *shrug*