Let’s be real, Lucas also directed ROTJ.
Are you on crack?
It’s commonly believed Lucas backseat directed much of the film, due to Richard Marquand’s shortcomings handling such a large complex FX laden production. IIRC, Lucas directing some second unit sequences is documented. He was definitely on the set much more than he was on Empire.