After watching Kenobi, I think the Lars kept Luke on or near the farm, only allowing him to get supplies in Anchorhead/Tosche Station. If he did go anywhere further than that, Owen or Beru were with him.

I think that’s why he wanted so badly to go to the Academy. He just wanted to go anywhere but where he was.

Just like Yoda said, “Always looking away to the future, never his mind on what he was doing.”

They even showed that in Obi-wan Kenobi when young Luke jumped up on the roof pretending he was in a pod racer or flying a ship. He wasn’t doing his chores like he was told.