SomethingStarWarsRelated said:

I’ve been waiting for this!

Man, the BTS footage is…confusing to look at!
I hope that, in the future, they’ll release another video breaking down a single scene or shot and how they achieve it.

Hopefully, as other shows and movies start using it, they’ll probably have to go into more details for the “general” public, especially when they’ll have to start teaching film students about it, etc.

They do illustrate fairly well at 0:33 how it works. From what I’ve gathered the camera is in contact with the computer(s) rendering the game-engine so that it can move around without revealing a 2D image (which happend with a lot of backdrops in old movies), but what I’m still unsure about is how the camera knows where it is located on the real set. I would assume this tech (for now at least) only works with certain digital cameras.

I’ve seen videos where they had one screen doing this, but when you wrap it around a whole set then it becomes complicated. I honestly had never in guessed that they’d used this technology for interiors, I assumed it was only for shots like the one with Mando and the child with the sunset in the background mentioned in the video, or f.ex. in ep. 1 when Mando and Quiil leans down on a ridge and sees the camp down in the valley. It’s really strange to see Herzog’s office just vanish and turn into a white wall (gave me a TNG holodeck vibe).