logo Sign In

SWxTPM-4DWHUXGA

Author
Time
 (Edited)

Star Wars by The Phantom Menace in 4D WHUXGA

To mechanically reproduce Star Wars using frames from The Phantom Menace at glorious WHUXGA resolution, creating an experiential 4D presentation.



WHUXGA = Wide Hex[adecatuple] Ultra Extended Graphics Array

WHUXGA is so HUGE it's not even on the map.  But it is in the wiki:

http://en.wikipedia.org/wiki/WHUXGA#WHUXGA_.287680.C3.974800.29

WHUXGA an abbreviation for Wide Hex[adecatuple] Ultra Extended Graphics Array, is a display standard that can support a resolution up to 7680×4800 pixels, assuming a 16:10 aspect ratio. The name comes from the fact that it has sixteen (hexadecatuple) times as many pixels as a WUXGA display. A WHUXGA image consists of 36,864,000 pixels (approximately 37 megapixels).

 


But back to this project.

SWxTPM-4DWHUXGA = 7680 x 3270 resolution

View the first frame now!:

 

http://noneinc.com/SWxTPM-4DWHUXGA/SWxTPM-WHUXGA_32x32x32000.jpg

(4.3mb)

 


8.33% reduced version:

Phuck yr 3D_halfBS, Phuck yr blu-shit, phuck yr fan-edit wankery, and most sincerely phuck you.

4D-WHUXGA!

Merry Christmas

none

Author
Time
 (Edited)

2012.03.03 : Preview Video (temporary soundtrack) : http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-Full-011a_H264SOUND.mov (107mb) 1 minute - 1920x816

This version showcases a transition of some of the preservations of the Star Wars, then transitions to the video mosaic during the Twin Suns shot, then transitions back to the beginning. 

Thanks to the mth3r, EDITDROID, 2004 DVD, Adywan, 2006 GOUT, dark_jedi, Harmy & 2011 BD. and MacOSaiX : http://web.me.com/knarf/MacOSaiX/Download.html

 

 

Space for Future Use

Author
Time

Space to slag off the haterz.

Author
Time

That may be the greatest thing in the history of the Star Wars franchise!  If this is pulled off right, I'll never watch those ugly theatrical (yuck) cuts again.

Looks like every Star Wars disc I already own is about to become a coaster.  And those LaserDiscs will make AWESOME coasters!

Author
Time

asterisk8 wrote: Sycophantic ass-kissing goes here.

Save it for the rest of the forum.

TV's Frink wrote: 16:10?  That's like one more than 16:9! 

...

I need a new tv.

We all do.  Wait till they realize they could have gone to Eleven.

OmegaMattman wrote: That may be the greatest thing in the history of the Star Wars franchise!  If this is pulled off right, I'll never watch those ugly theatrical (yuck) cuts again.

Looks like every Star Wars disc I already own is about to become a coaster.  And those LaserDiscs will make AWESOME coasters!

They also make good frisbies.  Or you can self-grove them and convert them into a vinyl record.

 

All the unnecessary drama and retardednesses aside.  The automation of this process is what's key.

The one frame example above uses 32,000 frames from TPM.  4 of the 24 frames from every second.  Would love to attempt this using all the frames but that's going to dramatically increases the processing time.

The other automation issue is right now it's a one frame creation at a time.  Figuring out either a different Mosaic application (using MacOSaiX currently) or how to control the OS to start up each consequtive frame is something i'd need to learn how to do.

The other unfigured out is the sound.  Have a program called Comparisonics which can take one wav and use it to recreate a second wav file.  But the application is for Mac OS9 and I was never able to figure it out, 10 years ago.  Need to contact the author to see if there is a new version (preferably GUI).

then if that works itself out, where could this thing be displayed...

 

So might just for shits'n'giggles.  take that one frame.  recreate it in Adobe After Effects then let the video play unaffected before and after for 1 minute, just to see what it looks like.  So you'd see this random image which would then for a fraction of a moment, making something recognizable, then go back to random.

Then there's the creative debate of what's more appropriate using the full OT to recreate the PT or vice-versa or is there some other appropriate more pseudo-4D like?

This is just one of those random projects I have sitting on the HD, which I start and realize i'm way in over my head...

Author
Time
 (Edited)

 

TV's Frink wrote: 16:10?  That's like one more than 16:9! 

...

I need a new tv.

We all do.  Wait till they realize they could have gone to Eleven.

Wow, imagine how cool a 16:12 picture would look!

Now that I think about it, a bunch of my movies are already formatted for 16:12.  The industry really needs to start making TVs in that aspect.  It'll be the wave of the future!  We can call it...SUPER DEFINITION (or SD for short)!

I think you should consider making this 4D project in 16:12 =)

Author
Time

Well, that's something you don't see every day. :)

The Star Wars trilogy. There can be only one.

Author
Time

Here are the results of a few more tests.  First test was to increase the image pool size.  From 4/sec to 12/sec.  And there is a pay off as the edge definition of the original on frame objects improves.  The sky becomes a little more blocky though.

Original (4/sec) - 32000 Frames

New (12/sec) - 95830 Frames

Full Size: http://noneinc.com/SWxTPM-4DWHUXGA/SWxTPM-WHUXGA_32x32x95830.jpg

 

And figured might as well see what happens when the other movies get added, so here's a test at 8/sec with TPM and AotC.

Full Size: http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-(8)_TPM-AotC.jpg

Cutting back to 8 from 12 affects the edge quality.  But internal definition, gradated areas, improve.  Luke's got eyes sockets now. But the overall face because the program is chosing color over composition seems to have suffered.

Had been letting the program run at night, but would often crash, so need to babysit and save every so often so the processing calculations aren't lost completely.  6 hours or so per frame.

 

So current thinking is as a proof of concept, do this one scene from SW, Luke and the twin suns.  Start with original footage, then fade/convert to just TPM mosaic interpretation, then add in the other two movies.  30 seconds or so.

Author
Time

Tests of the other two shots in this sequence:

Full size: http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-Sunsets-(8)_Full-PT.jpg

Wonky, unfortunately, hopefully better in motion.  So do I increase the 32x32 grid to something denser, but that would make the frames harder to distinguish.  The red sun is rather rank, reads well from a distance but lacks up close inspection relevance.

Full size: http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-Suns-(8)_Full-PT.jpg

This frame works.  The first sun is made up of Tatooine shots from TPM and the second sun shots of the climax of RotS.  Conceptually great.  Looked a lot better in the rendering process as the program started with RotS frames so the whole sky was a nice deep red of Mustafar.  But then the AotC frames dropped in the beige (upper right) stuff.  So this will affect the 3 movie mix.  maybe have the suns shot created by each movie alone then mix them together.  The mixing is the next unknown to tackle.

 

Skot wrote: Recycling is good.

Recycling is phun.

Recycling is best when it's...

...done with everything.

Author
Time

Working on a test of the twin suns shot.  The source of the film mosaic is a fade from the 1977 version thru 1997 thru 2011 versions.  Splitting that into three segments and applying TPM, AotC and RotS to each of the thirds.  This file is the first third showing how TPM recreates.

http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-Suns-36-TPM_H264at12.mov

[11.4 mb - 1 sec. - 1920x817]  1/4 of full resolution.

The source twin suns file looks like this:

http://noneinc.com/SWxTPM-4DWHUXGA/Blend-Suns-004.mov

Author
Time

So, who's up for sampling all the major vowel and consonant sounds spoken by all the characters in the PT, and remixing them to sound like the dialog from the OT, spoken by characters from the PT.

Because a great project like this requires an equally great soundtrack.

Project Threepio (Star Wars OOT subtitles)

Author
Time

fishmanlee said:

......?

this is wacky....I like it!

see the date of the original post.

later

-1

[no GOUT in CED?-> GOUT CED]

Author
Time

negative1 wrote: see the date of the original post.

This project and 'Thee Backslacpkping With Media' were both initially posted on that date.

Who's the more foolish? The fool, or the fool who follows him?

This quote will guide the next phase.  Need to get this test segment done as a proof of concept then see if the world wants to help out.  Can't complete this on my own.  Don't have the resources.

Author
Time
 (Edited)

Anyone have experience with installation and compiling of programs in Terminal (MacOSX), i'm requesting guidance/an education. 

Did some more digging and it wasn't Comparisonics but a program called Soundmosaic: http://awesame.org/soundmosaic/ (listen to the sample, neeto)

Have run the ./configure of soundmosaic and getting:

$ ./configure && make
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ./install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... no
checking for gcc... no
checking for cc... no
checking for cl.exe... no
configure: error: no acceptable C compiler found in $PATH
See `config.log' for more details.

The gawk, mawk, nawk i'm not sure how to address. (probably need to install the recommended Audio File Library first)  The C compiler seems to be the primary problem.  Guessing I need to re-install MacOS's coder software.  Found some mentions of BSD, but those were years old, and not part of the install discs of Snow Leopard (10.6)   If I install Xcode will that provide the C compiler?  Any kind of tips welcomed.

Author
Time
 (Edited)

none said:

Anyone have experience with installation and compiling of programs in Terminal (MacOSX), i'm requesting guidance/an education. 

Did some more digging and it wasn't Comparisonics but a program called Soundmosaic: http://awesame.org/soundmosaic/  (listen to the sample, neeto)

 your link gives me an error,

due to the extra characters at the end.

this works:

------------

http://awesame.org/soundmosaic/

i don't get it all.

the demo doesn't help.

and it doesn't really sound like anything close at all?

is there some kind of use, or a better demo/sample?

this doesn't seem to be very useful, or artsy at all.

later

-1

[no GOUT in CED?-> GOUT CED]

Author
Time

This thread makes my brain hurt.

Author
Time

none said:

Anyone have experience with installation and compiling of programs in Terminal (MacOSX), i'm requesting guidance/an education. 

Did some more digging and it wasn't Comparisonics but a program called Soundmosaic: http://awesame.org/soundmosaic/ (listen to the sample, neeto)

Have run the ./configure of soundmosaic and getting:

$ ./configure && make
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ./install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... no
checking for gcc... no
checking for cc... no
checking for cl.exe... no
configure: error: no acceptable C compiler found in $PATH
See `config.log' for more details.

The gawk, mawk, nawk i'm not sure how to address. (probably need to install the recommended Audio File Library first)  The C compiler seems to be the primary problem.  Guessing I need to re-install MacOS's coder software.  Found some mentions of BSD, but those were years old, and not part of the install discs of Snow Leopard (10.6)   If I install Xcode will that provide the C compiler?  Any kind of tips welcomed.

I think so, yeah.  Not having gawk, mawk or nawk is prolly no big deal since awk is there.

"Right now the coffees are doing their final work." (Airi, Masked Rider Den-o episode 1)

Author
Time
 (Edited)

negative1 wrote: http://awesame.org/soundmosaic/  i don't get it all.  the demo doesn't help.  and it doesn't really sound like anything close at all?  is there some kind of use, or a better demo/sample?  this doesn't seem to be very useful, or artsy at all.

The program is a tool.  How it is implemented, anyone can interpret as useful or artsy.  The bush-chimp sample is a progression from a low setting (think of a pictorial mosaic made up of 4 images) to a high setting (pictorial mosaic of 2000 images)  The last bit you are hearing is George Bush's audio micro-sampled to recreate the chimp's vocals.  Figuring out what level of sampling to use to 'hear and understand' the audio of Star Wars but also be able to pick out the audio qualities which represent the PT films will require trial and error.

Funcha wrote: This thread makes my brain hurt.

Go on.

Molly wrote: I think so, yeah.  Not having gawk, mawk or nawk is prolly no big deal since awk is there.

Right the compiler seems to stop when it reaches an impasse.  (for those learning along (as I am), awk is a program and there are versions.  for instance 'new' awk is nawk: http://en.wikipedia.org/wiki/Awk

 

After almost 10 years, finally figured out how to install soundmosaic and use the program.  (me 10 years ago: http://launch.groups.yahoo.com/group/databenders/message/312)

Here's a general description of the tasks/steps.  I'm on a Mac so the C compiler is on the system install discs under optional installation.  For OS10.6 it's called Xcode.  Then in Terminal was able to begin the installation of audiofile-0.3.3. (http://www.68k.org/~michael/audiofile/ )  Following the README, first you cd to the folder and ./configure.  (several pages of commands roll by)  Then 'make'.  (more pages)  'make check' then 'make install'.

$ make install
Making install in libaudiofile
Making install in modules
make[3]: Nothing to be done for `install-exec-am'.
make[3]: Nothing to be done for `install-data-am'.
test -z "/usr/local/lib" || .././install-sh -c -d "/usr/local/lib"
 /bin/sh ../libtool   --mode=install /usr/bin/install -c   libaudiofile.la '/usr/local/lib'
libtool: install: /usr/bin/install -c .libs/libaudiofile.1.dylib /usr/local/lib/libaudiofile.1.dylib
install: /usr/local/lib/libaudiofile.1.dylib: Permission denied
make[3]: *** [install-libLTLIBRARIES] Error 71
make[2]: *** [install-am] Error 2
make[1]: *** [install-recursive] Error 1
make: *** [install-recursive] Error 1

Got around the Permission denied by adding 'sudo' before the command which allows you to enter a password.  And finally some happy words:

Libraries have been installed in:
   /usr/local/lib

So then it's moving onto soundmosaic.  which when it plays out correctly goes like this:

$ ./configure && make
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a thread-safe mkdir -p... ./install-sh -c -d
checking for gawk... no
checking for mawk... no
checking for nawk... no
checking for awk... awk
checking whether make sets $(MAKE)... yes
checking for gcc... gcc
checking for C compiler default output file name... a.out
checking whether the C compiler works... yes
checking whether we are cross compiling... no
checking for suffix of executables...
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for style of include used by make... GNU
checking dependency style of gcc... gcc3
checking whether ln -s works... yes
checking for a BSD-compatible install... /usr/bin/install -c
checking for pthread_create in -lpthread... yes
checking for afOpenFile in -laudiofile... yes
checking for XOpenDisplay in -lX11... yes
checking how to run the C preprocessor... gcc -E
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for ANSI C header files... rm: conftest.dSYM: is a directory
rm: conftest.dSYM: is a directory
yes
checking for sys/types.h... yes
checking for sys/stat.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for memory.h... yes
checking for strings.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for unistd.h... yes
checking limits.h usability... yes
checking limits.h presence... yes
checking for limits.h... yes
checking malloc.h usability... no
checking malloc.h presence... no
checking for malloc.h... no
checking getopt.h usability... yes
checking getopt.h presence... yes
checking for getopt.h... yes
checking X11/Xlib.h usability... yes
checking X11/Xlib.h presence... yes
checking for X11/Xlib.h... yes
checking X11/Xutil.h usability... yes
checking X11/Xutil.h presence... yes
checking for X11/Xutil.h... yes
checking X11/Xos.h usability... yes
checking X11/Xos.h presence... yes
checking for X11/Xos.h... yes
checking return type of signal handlers... void
checking for getopt_long... yes
configure: creating ./config.status
config.status: creating Makefile
config.status: creating config.h
config.status: executing depfiles commands
make  all-am
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c
main.c: In function ‘soundmosaic_collate_attempts’:
main.c:1219: warning: ‘temp_streams[0]’ may be used uninitialized in this function
mv -f .deps/main.Tpo .deps/main.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT soundmosaic.o -MD -MP -MF .deps/soundmosaic.Tpo -c -o soundmosaic.o soundmosaic.c
mv -f .deps/soundmosaic.Tpo .deps/soundmosaic.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT sm_utils.o -MD -MP -MF .deps/sm_utils.Tpo -c -o sm_utils.o sm_utils.c
mv -f .deps/sm_utils.Tpo .deps/sm_utils.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT server.o -MD -MP -MF .deps/server.Tpo -c -o server.o server.c
mv -f .deps/server.Tpo .deps/server.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT io_buffer.o -MD -MP -MF .deps/io_buffer.Tpo -c -o io_buffer.o io_buffer.c
mv -f .deps/io_buffer.Tpo .deps/io_buffer.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT client.o -MD -MP -MF .deps/client.Tpo -c -o client.o client.c
mv -f .deps/client.Tpo .deps/client.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT http.o -MD -MP -MF .deps/http.Tpo -c -o http.o http.c
mv -f .deps/http.Tpo .deps/http.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT resampler.o -MD -MP -MF .deps/resampler.Tpo -c -o resampler.o resampler.c
mv -f .deps/resampler.Tpo .deps/resampler.Po
gcc -DHAVE_CONFIG_H -I.     -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format -MT graphics.o -MD -MP -MF .deps/graphics.Tpo -c -o graphics.o graphics.c
mv -f .deps/graphics.Tpo .deps/graphics.Po
gcc  -g -O2 -g -O2 -g -Wall -Wnested-externs -Wno-format  -L/usr/X11R6/lib -o soundmosaic main.o soundmosaic.o sm_utils.o server.o io_buffer.o client.o http.o resampler.o graphics.o  -lX11 -laudiofile -lpthread

May have done sudo for these commands as well.

 

And now for the testing.  Listen to these two short files:

Twin Suns audio clip : http://noneinc.com/SWxTPM-4DWHUXGA/soundmosaic/Source-TwinSuns-SmallPiece.wav  Soundmosaic considers this the target file, the one which is to be reproduced.  Testing with a 7 second clip from the Twin Suns segment as the music builds.

Source clip : http://noneinc.com/SWxTPM-4DWHUXGA/soundmosaic/Source-TPMLD-TF-Theme1min.wav This is the material soundmosaic will reuse to recreate the target file.  This is 25 second of TPM, some dialog before and after the Galactic Trade Federation theme, as they land on Naboo.

and here's the first two tests:  (i recommend listening on a loop)

Command: soundmosaic --partition --tilesize=0.1 zsource/Source-TwinSuns-SmallPiece.wav zoutput/sw4d-test-001.wav zsource/Source-TPMLD-TF-Theme1min.wav

returns: http://noneinc.com/SWxTPM-4DWHUXGA/soundmosaic/sw4d-test-001.wav (took a few minutes)

On first listen it's difficult to hear what sound mosaic is up to.  Soundmosaic uses a parameter called tilesize which in this case is .1 seconds long.  At this length you can pick out that there are different origins, for instance I can hear some Padme dialog in the beginning and a few times at the end.

So for the second test cranked up the tile size from .1 to .01.

soundmosaic --partition --tilesize=0.01 zsource/Source-TwinSuns-SmallPiece.wav zoutput/sw4d-test-002.wav zsource/Source-TPMLD-TF-Theme1min.wav

returns: http://noneinc.com/SWxTPM-4DWHUXGA/soundmosaic/sw4d-test-002.wav (took maybe 10 minutes)

Although it's very choppy, you can begin to hear the Twin Suns theme emerge from the TPM audio.

Then went back to listen to the first test and it's a little clearer how the tones soundmosaic is picking up to recreate.  The first quarter of test-001 I think is closer to where i'd like this to go.

Trying a third sample taking the first example and removing the --partition command, which increases the computational time but should be clearer.  been processing for awhile....  (zero on the progress *'s after almost a half hour...)

On the visuals, have the RotS frames created and running off some of the Luke before and after the Twin Suns shot.  Hopefully be able to post that this weekend or next week.

Author
Time

Preview Video (temporary soundtrack) : http://noneinc.com/SWxTPM-4DWHUXGA/SW4D-Full-011a_H264SOUND.mov (107mb) 1 minute - 1920x816

This version showcases a transition of some of the preservations of the Star Wars, then transitions to the video mosaic during the Twin Suns shot, then transitions back to the beginning. 

Thanks to the mth3r, EDITDROID, 2004 DVD, Adywan, 2006 GOUT, dark_jedi, Harmy & 2011 BD. and MacOSaiX : http://web.me.com/knarf/MacOSaiX/Download.html

(yes one of the video's compression got phucked (went all grey and retimed), will fix that for the final)

 

(soundmosaic is about 1/10th of the way done on this small test after 6 hours... Looks like --partition will be used from now on...)

Author
Time

We'll the third soundmosaic test finally finished after computing for 3.5+ days.

http://noneinc.com/SWxTPM-4DWHUXGA/soundmosaic/sw4d-test-003.wav

Some of the tones are a little stronger then the --partition quick test-001 version.  The problem is the sample base, it's too limited.  Next round of tests will be with a larger piece of the movie, working toward the full movie audio being digested.

One of the things learned in this third test is that it's probably best to not continue working at 4800khz.  Half of quarter resolution may work enough to show the theory can be pulled off.