The difference in costumes is a nonissue. The films are canonically set 25 years apart and an absolute minimum of 20. One would expect Boba's armour to have been significantly damaged, worn and upgraded in that time.
Also, the idea of him being in his 50s or 60s in ESB makes him even more of a badass, IMO.