Does the book say if the duel was shot before the scene with Luke and Leia in the Ewok village, or the big revelation with Ben? I'd guess those last two were shot with as little crew as possible. Less potential loose lips.
IIRC, all the Endor locations in Northern California were the last scenes shot, so obviously they had it figured out by then.