I played a bit with this movie and it can be improved by some scene reordering and trimming of Roper and Williams.
Basically:

Open with Roper and Williams flashbacks
Tighten pacing on Lee’s fight, abbot scene, recruitment.
Tighten boat sequence to get them all to the island quick.
Add deleted scenes to show Lee as a master (show his book)
On the island, tighten dinner scene around Lee
Only one night passes (condense all action to one night)
All tournament sequences happen the following morning/day, trim Roper and Williams fights.

Just putting this here because it works reasonably well and fits the existing footage.