Historic Moon Landing Footage Enhanced By AI, and the Results Are Incredible (universetoday.com) 66
"A photo and film restoration specialist, who goes by the name of DutchSteamMachine, has worked some AI magic to enhance original Apollo film, creating strikingly clear and vivid video clips and images," reports Universe Today:
Take a look at this enhanced footage from an Apollo 16 lunar rover traverse with Charlie Duke and John Young, where the footage that was originally shot with 12 frames per second (FPS) has been increased to 60 FPS... And I was blown away by the crisp view of the Moon's surface in this enhanced view of Apollo 15's landing site at Hadley Rille... Or take a look at how clearly Neil Armstrong is visible in this enhanced version of the often-seen "first step" video from Apollo 11 taken by a 16mm video camera inside the Lunar Module...
The AI that DutchSteamMachine uses is called Depth-Aware video frame INterpolation, or DAIN for short. This AI is open source, free and constantly being developed and improved upon... "People have used the same AI programs to bring old film recordings from the 1900s back to life, in high definition and colour," he said. "This technique seemed like a great thing to apply to much newer footage...."
DutchSteamMachine does this work in his spare time, and posts it for free on his YouTube page. His tagline is "Preserving the past for the future..." And he's planning to keep it all coming. "I plan to improve tons of Apollo footage like this," he said. "A lot more space and history-related footage is going to be published on my YT channel continuously." He also has a Flickr page with more enhanced imagery. [And a Patreon page...]
Long-time Slashdot reader schwit1 calls it "similar to what Peter Jackson did with old World War I footage for They Shall Not Grow Old ."
The AI that DutchSteamMachine uses is called Depth-Aware video frame INterpolation, or DAIN for short. This AI is open source, free and constantly being developed and improved upon... "People have used the same AI programs to bring old film recordings from the 1900s back to life, in high definition and colour," he said. "This technique seemed like a great thing to apply to much newer footage...."
DutchSteamMachine does this work in his spare time, and posts it for free on his YouTube page. His tagline is "Preserving the past for the future..." And he's planning to keep it all coming. "I plan to improve tons of Apollo footage like this," he said. "A lot more space and history-related footage is going to be published on my YT channel continuously." He also has a Flickr page with more enhanced imagery. [And a Patreon page...]
Long-time Slashdot reader schwit1 calls it "similar to what Peter Jackson did with old World War I footage for They Shall Not Grow Old ."
It's fake video (I mean the AI part) (Score:2, Insightful)
Watch the first video on the linked web page and pay attention to the part of the image looking between the camera and the cable loop. Notice that as the rover bounces the scene pans across the video that the rocks seen don't stay in the same places! when they are outside the loop they are in one place and then when they move inside the loop they have shifted positions relative to the other rocks still outside the loop!!!!!
SO the restoration method isn't actually showing you anything real. it's just show
Re: It's fake video (I mean the AI part) (Score:4, Interesting)
Well, they can only do so much. They are having to guess between frames and its not always perfect. For example in Jackson's They Shall Not Grow Old you could often see some blurring or smearing where the program couldn't create a perfect, seamless video. But overall these kinds of updates are pretty amazing and really make these old videos feel more "real".
Re:It's fake video (I mean the AI part) (Score:5, Insightful)
SO the restoration method isn't actually showing you anything real
Of course it isn't. Information that's not there can't be conjured into existence, even with, er, "AI".
What they're showing is a visually nice interpolation/extrapolation/prediction, a plausible guess at what the missing information may have been, guided by a handful of rules derived from knowledge on human perception with the goal of creating a subjective improvement.
It's really quite a feat and rather stunning to watch though.
Re: (Score:2, Funny)
What I don't understand is why they had to do this at all.
Couldn't they have just gone back to the original sound stage in Area 51 and reshoot those parts? I mean, they are wearing space suits, so it won't be like anyone will notice the different actors?
The could shoot in it 3D and IMAX as well.
Re: (Score:2)
Re: It's fake video (I mean the AI part) (Score:1)
Careful, the moon hoaxers WILL take your post seriously. :\
Re: (Score:3)
SO the restoration method isn't actually showing you anything real. it's just showing you something that looks good.
You need to take the red pill to see the correct version.
Re: (Score:2)
SO the restoration method isn't actually showing you anything real. it's just showing you something that looks good.
I can't wait for the conspiracy theorists to start saying "60fps video proves it was faked"
Re: (Score:2)
SO the restoration method isn't actually showing you anything real. it's just showing you something that looks good.
That can be said for every restoration method since the "real" involves the low quality of the storage medium.
Re: (Score:2)
Not to mention lossily compressed images, videos and music. Lossy compression is all about choosing which information to discard so that the reconstruction looks or sounds good.
Re:Just a reminder... (Score:5, Funny)
Re:Not AI (Score:5, Funny)
"It's the soap opera effect you can find in any television."
Exactly. Soon the AI will just need a beginning and ending frame and then it creates a 10 season soap on the fly.
Re: (Score:2)
Red Dwarf - Theme to "Androids - The Soap Opera"
https://www.youtube.com/watch?... [youtube.com]
Re: (Score:2)
Seriously though, are we really that far away from an AI application that will write the perfect summer blockbuster movie just from some key words and a bad sketch on a napkin?
And to film it, it just dips into a huge library of derived or totally artificially-generated actors, each one perfectly tuned for the emotional effect their physical appearance, voice and body language will elicit?
That creepy Black Mirror episode is not that far away when anybody with a decent PC and the patience to study and try out
Re: (Score:3)
Who is this Al guy? And can he apply his talents at Slashdot to help them choose better fonts?
Re: (Score:2)
And make it Unicode compatible? I'm tired of the weird shit that appears whenever I type a '''.
Re: (Score:2)
Hey, that helped! :)
you wouldn't believe what happens next! (Score:1, Funny)
Re: (Score:3)
Someone already did a demo of that: https://youtu.be/XWBiHDchSLA [youtu.be]
Sod voyager though, we need DS9 in HD.
Re: (Score:2)
Re: (Score:2)
He's working on that too :P Read the description of your own link:
I have a few DS9 clips as well. Including battle scenes - https://youtu.be/kt-pczNKjFE
Re: (Score:2)
Yeah, there are a few demos on YouTube already. I don't know if it's a viable way to restore the entire series.
I was hoping they would do it after TNG. It was shot on film the same way but there are a lot more CG effects in DS9 that would all need to be recreated from scratch for HD. Apparently there is a documentary "What We Left Behind" that has some re-scanned film footage from one of the season 7 episodes but I haven't seen it yet.
Re: (Score:2)
Re: (Score:2)
Dax
Better to just recreate the movie (Score:5, Insightful)
One we get in the habit of "AI enhanced" videos of historical events, things can go bad pretty quickly when the AI starts being used to eliminate "objectionable" content
Re: (Score:3)
"One we get in the habit of "AI enhanced" videos of historical events, things can go bad pretty quickly when the AI starts being used to eliminate "objectionable" content"
That's what 'history' is, the winner says how it was.
Re:Better to just recreate the movie (Score:4, Interesting)
The original video had a low framerate. It was shot on a film camera with selectable framerates. To save weight they'd switch the framerate depending on what they were doing. Some sections were shot at 1 fps.
These low framerates were acceptable for the original purpose of the film (to serve as a scientific record). The drawback is that the human brain doesn't do so well when viewing motion at low framerates.
Image stabilization and interpolation help make the content more enjoyable to watch, and more immersive. For e.g. the rover traverse videos, smoothing out the motion gives you a better idea of how the rover moved over the bumpy terrain (and how weird that motion is due to the 1/6G).
For things like the Moon landings, there's no way to recreate the footage with a fidelity as good as the original.
If you recreate historic footage, you have more scope than with the current AI to insert inaccuracies or downright lies. This becomes a problem only when the original footage is subsequently made unavailable.
Re: (Score:3)
It's such a shame that the original tapes have been wiped or lost. Kind of amazing that no-one thought to preserve such an important moment in our history.
The moment Armstrong stepped off the ladder is now only preserved as a low quality copy from the broadcast.
Re: (Score:2)
The original video had a low framerate. It was shot on a film camera with selectable framerates.
Is the original source video no longer available?
Couldn't they post a before and after split screen?
Re: (Score:2)
The originals are obviously available (well, video transfers of the original film magazines), as they were the source for this increased-framerate version. They can be found in the Apollo Lunar Surface Journal [nasa.gov], a complete record of all media created during the lunar missions. NASA also has its own Youtube channel with lots of lunar mission video.
DutchSteamMachine has done several side-by-side videos of the original and his version. They can be found on his YT channel.
Re: (Score:2)
You don't need "AI" to eliminate objectionable content from historical events. We've been able to do that for years. AI is only automating things we've been doing for a long time.
Like reliving my childhood (Score:5, Interesting)
Re: (Score:2)
You too... I never forgot it. people were partying all up and down the street, it was all you heard about for weeks... it filled me with a feeling of wonder and awe that is still there today
Re: (Score:2)
I just hope in my lifetime to witness the next walk on a celestial body, moon or mars... I'll be glued to my screen(s).
Re: Like reliving my childhood (Score:2)
The sad fact of our moribund manned space program,, remembering that personally puts you at/near/over 60.
It looks nice, but not real (Score:5, Insightful)
It looks nice, but it's not real. I enjoy watching it, and hope others do, too, but I especially hope that people in the future won't forget to look at the original foots for the real details, should they wish to comb over things. We don't want the fake stuff to become authoritative.
Re:It looks nice, but not real (Score:4, Interesting)
The computer isn't inventing anything, or at least it shouldn't need to.
There have been several stories here on slashdot about building up high resolution images from low resolution sources. I recall seeing some amazing pictures taken by a 25kilopixel QuickCam. Film of the lunar surface is probably about the ideal for this sort of thing.
Basically, you use visible features to line up two sequential images and figure out the transformation between them. The alignment will never be perfect - there will be some sub-pixel jitter between them, which is actually a good thing. You basically do the inverse of anti-aliasing and build up a virtual picture with a higher resolution than any of the original pictures.
You can also detect and reject defects, including motion blur. Missing a frame here or there isn't a big deal. Even better, you can usually still figure out motion from a blurred frame, so even if a frame is too blurry to contribute to the detailed image, you might still have authentic motion for that section.
Of course, in reality, the system probably does something closer to a single pass. If you have more time than memory, at each output frame, you look at past and future frames to build up the output image. If you have more memory than time, you do an actual single pass with incomplete frames in memory.
This is complete speculation on my part. I haven't looked into the technique he is actually using. I'm just saying that I'm familiar with techniques that he could be using that would make these videos almost as "real" as the original film prints.
Re: (Score:2)
Much of the Apollo 11 footage isn't "real" any more, in the sense that the original video has been lost and now all we have is copies of the broadcast which has the brightness and contrast messed up. That's not how it really looked or an accurate representation of what the astronauts could see. It looks way brighter than it was, for example, with even harsher shadows.
The photos they took are much more accurate.
Re: (Score:2)
That's more to do with exposure, which on the decent from the steps of the lander, you can see them adjusting through the scene. There's no atmosphere. The sunlight and contrast would be extremely harsh in reality - but the human eye is better than film at capturing all those details at once.
Re: (Score:2)
It was much better on the original video, of which only a few stills remain. It got messed up when broadcast and recorded off the air.
Re: (Score:2)
Note that that applies to recordings made of the live TV coverage. The astronauts also had a 16mm film camera, those originals are still available.
Re: (Score:3)
We don't want the fake stuff to become authoritative.
For science? No. For entertainment? Yes. People don't get excited for blurry 1fps footage.
While perhaps interesting, I do not think that... (Score:1)
We already have no lack of people convinced that the moon landing was a hoax and the video footage faked without giving these morons even a morsel of truth to the conjecture.
Re: (Score:2)
So because of a few nutjobs, we should deny ourselves some incredible enhanced footage of one of the most momentous achievements in human history? I think not.
Every single issue these idiots have raised has long since been scientifically debunked. At this point, we're better off just ignoring them. The very last thing we should do is allow them to dictate any of our actions.
Re: (Score:2)
I don't deny that this is certainly interesting, and I do not discount the original event's historical significance, but in the end, the gains that are aquired from this are really only very superficial... it ultimately only changes how the footage *looks*, nothing more. Nothing new about what happened can really be learned from the enhanced footage which could not also be learned as easily from the original. This might certainly be fine for entertainment purposes, but of negligible value in any other
Re: (Score:2)
I'd certainly never argue that this has any scientific value at all. It's value is purely entertainment and cultural. There's really nothing wrong with that. In fact, I think by making the footage clearer, newer generations can better appreciate those achievements from several generations past. In the same way that I think colorized WW2 footage helps humanize that most intense of all human dramas for modern generations, this enhancement will make the moon landings perhaps feel a bit more "real" to some.
Re: (Score:2)
Re: (Score:2)
Agreed. There are a few that we could send into space so that these so-called "nut jobs" (I prefer the term lunatic myself) could see for themselves where the word came from--nothing personal.Give them one of those portable canisters for gas, since they think they're taking a trip to Arizona or something, and they could always use some extra gas for the return trip.
One of the documentaries finally told me how Neil Armstrong became the astronaut/commander; won't spoil it for you. I was eight years old at the
Too bad they threw out the high-resolution video (Score:2)
Too bad they threw out the original high-resolution videotapes recorded via Australia and other points many decades ago.
*sniff*
Re: (Score:3)
High-resolution is relative [stackexchange.com].
The SSTV system used in NASA's early Apollo missions transferred ten frames per second with a resolution of 320 frame lines using less bandwidth than a normal TV transmission.
The lost tape did have better quality than the surviving TV recordings. Neither can hold a candle to the 16mm film recordings this story is about, but the 16mm cameras weren't running continuously.
NOT AI!!!!! (Score:1, Informative)
DeepFake (Score:2)
I can't see any value in further muddying the waters of what historical footage is real and not real.
"look at how clearly Neil Armstrong is visible"
No. "Look at how clearly the CGI Neil Armstrong is visible in this DeepFake footage of the moon landing" is what you mean.
Re: (Score:1)
Deepfake of a fake moon landing. Fakeception.
Re: (Score:2)
Deepfake of a fake moon landing. Fakeception.
Rule #1: don't be a dick. Rule #2: if you can't help being a dick, keep quiet.
Re: DeepFake (Score:1)
Not to mention the unintentional errors of mistaking one object for another. The human visual system, which is far ahead of any AI often gets fooled like this.
Yeah but (Score:1)
It;s producing something that looks good, but are the details authentic?
You can't get any new real information that wasn't there in the recording in the first place. The software can take something that might be a small crater, and upscale it to look like a crater, but what if it was really a rock?