logo Sign In

The Original Trilogy restored from 35mm prints (a WIP) — Page 25

Author
Time

yoda-sama said:

I’m paranoid about RAID for reasons like this… It may not be as good, but I just rsync what I need backed up… Not that that helps any right now. Good luck on the motherboard hunt, and yotsuya’s suggestion of contacting Gigabyte might actually be a good idea at this point.

The RAID is for speed, working with files that require 2.88GB/s transfer rate to maintain realtime playback is the main issue. In this case it isn’t about redundancy, just about transferring data at decent rates so you aren’t waiting on the I/O constantly.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

poita said:

yoda-sama said:

I’m paranoid about RAID for reasons like this… It may not be as good, but I just rsync what I need backed up… Not that that helps any right now. Good luck on the motherboard hunt, and yotsuya’s suggestion of contacting Gigabyte might actually be a good idea at this point.

The RAID is for speed, working with files that require 2.88GB/s transfer rate to maintain realtime playback is the main issue. In this case it isn’t about redundancy, just about transferring data at decent rates so you aren’t waiting on the I/O constantly.

Oh right, sorry, just kind of assumed for a bit there that RAID for storing scans that are so expensive to acquire would be for redundancy, but you’re totally right about access time for actually working on them, I should have put that together sooner. So, how are you doing when it comes to redundancy? Do you have backups of at least the original scans on external hard drives? With the amount of calamities that seem to befall you, you may be best having offline backups that are not connected to power whatsoever, maybe even in a safe, or vault… located in a panic room… underground.

Author
Time

Yeah but unfortunatly I guess you cannot make backup easily when you need 20+ TB of storage for one movie 😵

Author
Time
 (Edited)

Backups are a problem, to backup the scans I currently have would take roughly another 240TB of HDDs, which in the current market is around US$8,500 worth of drives, which is money I don’t have right now.

Every time a new print turns up, the storage cost alone to store the scan and make a backup is about US$1800 just in hard drives for a single film.

So some of the scans do not have backups, which is frustrating and dangerous, but unless a Simon Pegg-like-mega-fan with deep pockets, or the much wider community crowd funded a lot of HDDs, then having backups is unfeasible.

Making lower resolution ProRes copies of the raw scans is the best I can manage at the moment, but even that is a stretch sometimes due to lack of space.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

Thanks, that is the most affordable one so far.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

I found one locally, and have picked it up and am installing it tonight.
Fingers crossed.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

poita said:

I found one locally, and have picked it up and am installing it tonight.
Fingers crossed.

We are all crossing our fingers.

Author
Time

Eventually it is time again to raise some funds for you. 😃

Author
Time
 (Edited)

Good news… after messing around pulling RAM sticks, I got the system to boot with the new motherboard.

Bad news, I’m down 32GB of DDR4 and one of the 5TB WD Black HDDs in the array is reporting as failed, so it looks like I have lost all of the WIP on the 2nd RAID. The SSD RAID has come up just fine.

So the carnage was UPS, Power Supply, Motherboard, half the RAM and one HDD, and a few weeks work, and one reel that I don’t have a raw backup for.

It could have been a lot worse.

Thanks for all the crossed fingers, I’m off to bed now, will make a plan in the morning as to where to go from here.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

poita said:

Good news… after messing around pulling RAM sticks, I got the system to boot with the new motherboard.

Bad news, I’m down 32GB of DDR4 and one of the 5TB WD Black HDDs in the array is reporting as failed, so it looks like I have lost all of the WIP on the 2nd RAID. The SSD RAID has come up just fine.

So the carnage was UPS, Power Supply, Motherboard, half the RAM and one HDD, and a few weeks work, and one reel that I don’t have a raw backup for.

It could have been a lot worse.

Thanks for all the crossed fingers, I’m off to bed now, will make a plan in the morning as to where to go from here.

Glad to read that it wasn’t too bad Poita, and that you were able to save most of your work!

Author
Time

That certainly sucks, but thank god the new mobo was able to reuse the existing raid arrays. i have heard anecdotal horror stories about firmware mismatches causing issues with this. not a fun situation, but it could have been worse i guess.

how is your house cleanup going?

Author
Time

A failed hard drive is not necessarily a deal killer, even if it’s from a RAID array. There is a chance that a professional recovery outfit could recover it. I’ve had to pay for this in the past and it definitely wasn’t cheap, but it might be more cost effective than rescanning a whole reel. I’ve used a service that charges about $300 US for a typical drive, or $600 for a RAID array.

If I had some gum, I’d chew a hole into the sun…

Author
Time

Luckily, it wasn’t as bad as it could’ve been. That’s a real pain to lose a HDD. Sure losing a PSU or RAM is annoying, it’s a lot easier to replace and not cause a big problem.

Author
Time

dahmage said:

That certainly sucks, but thank god the new mobo was able to reuse the existing raid arrays. i have heard anecdotal horror stories about firmware mismatches causing issues with this. not a fun situation, but it could have been worse i guess.

how is your house cleanup going?

The roof has been sealed up, and the place is nearly back to normal.

Yeah, one RAID was on a hardware card, it came back fine, the mobo RAID didn’t come back, the one HDD failure killed it. It was a 7 drive array, so packing that up and sending it to data recovery, with no guarantees, and unable to use the machine in the meantime, I’m not sure it is worth it. I have the ProRes of that reel, so I think I will just work from it.

The memory is a pain, it drops me back to 32GB which isn’t enough to work in 4K with my restoration software, so I’m looking at that now. So far the total damage from the PC looks like being around $800 or so, which isn’t the end of the world. The lost time and work is frustrating though.

As I can’t render, I’m going to go through and ‘GOUT Sync’ the scans I have, i.e. put a “MISSING FOOTAGE” frame placeholder into all of the frames that are missing from the frames compared to the GOUT. That should make it easier down the track to keep everything synched and far easier to insert footage from other scans etc. where required. It also means timelines will align between multiple scans from different prints, which I think could be handy.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

poita said:

dahmage said:

That certainly sucks, but thank god the new mobo was able to reuse the existing raid arrays. i have heard anecdotal horror stories about firmware mismatches causing issues with this. not a fun situation, but it could have been worse i guess.

how is your house cleanup going?

The roof has been sealed up, and the place is nearly back to normal.

That is good! I hope everything says ‘normal’ for quite some time. 😃

Author
Time
 (Edited)

dahmage said:

poita said:

dahmage said:

That certainly sucks, but thank god the new mobo was able to reuse the existing raid arrays. i have heard anecdotal horror stories about firmware mismatches causing issues with this. not a fun situation, but it could have been worse i guess.

how is your house cleanup going?

The roof has been sealed up, and the place is nearly back to normal.

That is good! I hope everything says ‘normal’ for quite some time. 😃

It will not be normal, it will be great 😉

Author
Time

poita said:

The memory is a pain, it drops me back to 32GB which isn’t enough to work in 4K with my restoration software, so I’m looking at that now…

Are you looking to find 4x8gb sticks? Any particular speed?

Author
Time

I’m back home, but a bit knocked around.
Will update soon.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

We are packing up and leaving for my parents house at the coast for a few days, the bushfires near here are getting out of control.
https://twitter.com/nswrfs?lang=en

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time
 (Edited)

poita said:

We are packing up and leaving for my parents house at the coast for a few days, the bushfires near here are getting out of control.
https://twitter.com/nswrfs?lang=en

Yikes…get out and stay safe Poita. Am praying that you and your family don’t loose your property to these awful fires.

Author
Time

Our house should be okay, it is in a highly defensible area, but the RFS has told anyone to leave that is able to, so we decided to go. All important stuff is with us, or at a secure location, so all should be fine. We will be coming back Tuesday if all has settled down.

Donations welcome: paypal.me/poit
bitcoin:13QDjXjt7w7BFiQc4Q7wpRGPtYKYchnm8x
Help get The Original Trilogy preserved!

Author
Time

Wow! You’ve had way more than your fair share of troubles lately. Stay safe, and may the Force be with you!

Forum Moderator

Where were you in '77?