Well I mean Yoda only said it was the Force that should never be used to attack. You could argue that the unruly bar flies being chopped just with a weapon was fine.
I guess. I always imagined that using a lightsaber required constant usage of the Force, using precognition to know where to position the blade, resulting in those famous Jedi reflexes.