Thanks for replying.
Yes, I've got ESB v2.0 (downloaded as an .mkv file), but when I bring it into tsMuxeR the "Custom Chapters List" field is empty (even with that radio button selected).
Same with RTJ.
On the other hand, the chapters from the .mkv of ANH 2.5 come in perfectly.