So here is the list of all the videos from the Rinzler ebooks

Making of Star Wars

Stuart Freeborn and his people creating alien costumes
test footage of earlier design of R2D2
test footage of different lightsaber techniques
test footage of Kenny in an unpainted R2D2
Luke with Treadwell and the moisture vaporator, different takes from the Blu-ray version
Alec Guiness having fun with Kenny Baker as R2 and picking up 3PO in the “wrong step” scene
“Well there we are, Mos Eisley spaceport” - “I’m ready for anything” - longer version of the scene used in the movie
eating in the Lars homestead
random Arabs in droid costumes
interview with Alec Guiness, longer version of the interview used in the 1977 documentary
cantina fight, I think it’s the same as in Empire of Dreams
different takes of Han / Greedo sequence, includes Greedo’s “Jabba would rather have your ship” line which is missing from the Blu-ray deleted scene, also “I’ve been looking forward to it for a long time”
putting Vader into his costumer
stormtroopers running in corridors, probably cut from the final Death Star battle
a longer version of “you’re braver than I thought” scene, includes the heroes running into some imperials and just walking casually away
Han hunting the stormtroopers, I think the same scene was used in Empire of Dreams
Luke and Leia jumping across the gap - alternate take -with more dialogue (for luck, we’re gonna need it)
extended scene of destruction of Alderaan (and you call yourself human)
escape from the Death Star - alternate angles
Vader / Obiwan duel
interview with Mark Hamill
“That old man is mad!” “You said it Chewie” + “She’s beautiful.” - “So is life”.
battle on the Tantive IV - alternate takes / angles
Vader strangles the captain, original cut with original dialogue, a longer version of the clip used in Empire of Dreams
extended scene of sandpeople trying to climb on the bantha
bit of original title crawl + more previously unseen shots from the Tantive IV battle
gag reel - different from the one on the official DVD

The Making of Empire Strikes Back

Vader and Boba Fett on some parade or something?
the droid from the beginning explores some flaming metallic debris - I wonder what it is
alternate take of the scene where Luke says to Leia he wants to leave - different angle, and longer than the version on the Blu-ray, includes dialogue about the ice creatures and their invasion of the base, and Luke’s “stoned” reaction to “laser brain” and “fuzzball”
Mark training with sword
Mark interview
instructing the rebels before the snow battle
different angle of the scene where Vader has no helmet on
Kerschner shooting the hangar scene
Kersch instructing the actors for the briefing scene in the hangar with a coked up looking Carrie
different longer version of Han yelling at Chewie, Chewie speaks english
different version of Luke landing on Dagobah
interview about Yoda
different angle of Luke / Vader “steamy” duel
Luke meets Yoda, different version
divers rescuing R2 from the swamp
interview with Carrie
temp version of the snow battle, temp music from Star Wars, animatics instead of ATAT footage and death of general Veers
ILM backstage
watching dailies
longer version of the wampa attack on Luke
early version of droid at the beginning destroying something metallic, half of it is just animatic + Luke killing a wampa
scoring
Ben Burrt creates sounds effects
scoring

Making of Return of the Jedi

animatic of the forest sequence
building Jabba
Ewoks welcome the heroes to the tribe, different angle
Jabba’s original English dialogue, quite different from the final subtitles
Jabba’s death - alternate take
3PO loses his eye - alternate take
preparing admiral Ackbar
behind the scenes footage before the briefing
bearded guy and his crew
Luke / Vader duel alternate
lost pilot - not on the blu-ray scene
death of Palpatine - alternate take
Luke tries to persuade Vader, with the director speaking for Vader
various Sarlac shots
shooting the desert fight
shooting the forest battle
temp version of the attack on the Death Star from inside features different shots from the Blu-ray scenes
Luke in the cave, he tries to jump up and get through the bars
Emperor teases Luke, and asks the commander to blow up Endor - different angles from the Blu-ray deleted scenes
longer version of the team splitting up
temp version of Luke constructing his lightsaber, with different actor playing Luke and R2 and 3PO played by toys
Vader teases Luke - original audio
3PO and R2 going to Jabba’s palace - different dialogue
original ending, with Yub Nub with English lyrics and I think also some different editing