Here's how I did it. Not the most elegant spreadsheet, but it worked...
(You won't need the "Adjusted Frame Number" column.)
Then copy columns K to O, from row 2 onwards to the last chapter, and "paste values" into another worksheet. Save this worksheet as a csv file, then you can import straight into CCE.