Yeah I think that works better. And personally I thought the only Imperial March you needed was when we first see Vader in his castle. The other usages felt kind of extraneous to me personally, but I don’t dislike them either.
Funny enough, I cut the one when he arrives at the village. So it’s just the first intro to him at the castle, and the bit at the end after the duel.