How to Fake it ALL! -Virtual and Augmented Reality

Video Transcript:

​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ ​ This might be the future of computing. This is what the world could look like with Magic Leap, a new technology which stands to upend the way we work, communicate and play. We've created a digital light field signal that mimics how the world, the visual part of the world, like really interfaces or talks to your brain. The world is a world of technology. The world of computing is a world of technology. The world of computing is a world of technology. The world of computing is a world of technology. The world of computing is a world of technology. You've heard of VR, you've heard of AR. While Roni is working on something that he calls MR. Mixed Reality. That's the way of tricking the brain to think that digital light signals made in Magic Leap goggles are as real as the world around us. This is Widowmaker, one of the characters from Overwatch in his house, including by the way Fog and Lighting effects. That's terrifying. Hey Widow, where are you in the room? We have to introduce the concept of free fold. Let's use this model of the Earth. Let's list the help of a friend. He might know her. When it's significant about this video is number one that was live to school children. Number two, we have this stuffed animal that is transitioning in on another video channel. The actor is able to reach up and grab this doll in real 3D space and manipulate this doll with their hands. The only way you're going to pull that off is with one technology. That technology is virtual reality. One, partly, though, is something called Augmented Virtual Reality. Before 2012, NASA used masking techniques like we do in Photoshop and After Effects. Now we're able to simulate water and objects live in real 3D space. We're able to take models of things that are photorealistic and rotate and move them while we are going live. Before we used to have to render these effects framed by frame by frame, and it took extremely long amounts of time. In this video here, I made last year using Sony Vegas. I was just playing around with the masking capabilities of Sony Vegas. I don't even know why I saved this video. I was just lifting up this trash can to make it look like it's floating. I didn't do a lot of work on this. It was just something I wanted to see real quick. But that is a masking effect to get another effect. We now have the technology to simulate water, materials, fabrics, and live in real 3D space with virtual reality, and all augmented virtual reality is taking the objects in 3D space from a virtual reality world and putting them in our world on another screen, which we can see manipulate and touch with virtual reality contacts or classes. In this next segment, I'm going to show you how NASA grabs objects in 3D space, rotates them around, manipulates them, they can do this with water, with cloth, anything. The cool thing about it is we can take what they're doing, what they're seeing with their contact virtual reality augmented lenses, and put that on a separate video layer live. Yes, live. And do it all in real time. So I'm going to show you what it looks like to them as they're grabbing objects and manipulating them. And then I'm going to show you Microsoft's HoloSense video. Their demonstration V3 a couple years ago of bringing a virtual reality into our world, and it is simply amazing. Let's watch. Specifically, how HoloLens can turn every room of your house into a personalized video game level. But today, we want to take mixed reality one step further, so we've got something new to show you. Holograms you can hold. This holographic gauntlet is the weapon that Dan will be using while playing Project X-Ray. You'll notice that as he moves his arm, the hologram moves as well. This is a wearable hologram. And when you combine technology like this with the environment understanding of HoloLens, you can do some pretty spectacular things. And you can even use your shield to defend himself. What's like that's all of them. In 2012, NASA got tired of thinking weightlessness by using the 0G plane, better known as BOMA Common. So in 2012, they started soliciting companies that specialize in real-time, argumented virtual reality so that they can fake weightlessness and floating objects in the air in real-time. Simply the cost of the plane and the safety concerns and the fact that they weren't very good at it, they didn't go to Hollywood which most of Hollywood's effects are both processing that's after the video is made. They needed something they can do in real-time and make it look realistic. And so I'll put this link in the description. They found a company called Telemetrics. Thank you Debbie for bringing this to my attention. After I researched this, slowly I found out our government has a contract with these people. And Telemetrics, basically what they do is they help news teams and they bring broadcasts together in real-time and they're able to create sets, cities, anything you want in a virtual reality world and make it look absolutely 100% real. And they're able to bring different people from around the world, put them in the same room and broadcast live and give them deaths whatever they need to make the broadcast. So it's a pretty amazing company. Here we see Johnson Space Center Telemetrics provided by the latest camera robotics technology and NASA's government television at Mission Control. Why do you need to fake virtual reality sets at Mission Control in Johnson Space Center? I think we know the answer to that when we saw Tim Beap on the grid at Blue Screen. This next segment, I'm going to show you what it looks like when virtual reality being broadcast live doesn't work out so well because the system's not perfect. And then at the very end, I'm going to show you the mother of all screw ups when they actually have a channel shut off that should be on. Because once again, these astronauts were looking in 3D space, they are grabbing objects because they weren't argumented contact lenses. And if that object's not their broadcast to the viewers live, then it's going to look pretty ridiculous. So let's see some of NASA's screw ups. I'll cover them as they happen. So this is one of NASA's older videos where they use post-processing and masks. This is a video layer mask in argumented virtual reality. We're going to see them lose their finger here and the watch glitches out. So I guess virtual reality accidents can cause lots of fingers. In this next video, we have a caddy. Now I want you to pay attention to her neck and the way her neck line goes into the shirt it's cut off. And the necklace. Apparently they wanted to show how cool this necklace look. Unfortunately, it's not perfect. The necklace goes in and out of her shirt unnaturally and her neck glitches in several places. I literally spent hours going after probably 30 or 40 videos, probably had approximately 45 minutes straight of NASA's machine at the virtual reality setup. I tried to pick some clips that were obvious and some not so obvious. I'll show you some of the contacts. We're going to see Tim Peek with his contacts. But these are virtual reality contacts, overlaid on the eyes so that actors can interact with things in 3D space all in real time. Tech Giants Sony has joined the race to develop digital contact lens technology. According to an application filed with the US patent office, Sony has plans for a wearable lens that can take photos and video. Sony filed a patent in the US in May of 2013 for a smart contact lens, a fact only picked up by the media this week. The device would not only take photos and video, but also store data, with no need for a tether to a smartphone. The lens would feature an organic, electro-luminous and display screen. By blinking an eye, the user would be able to operate the lens via the display. The camera would feature auto-focus, automatic exposure adjustment, and an adjustable zoom. The device would also be able to record video, store it, and play it back. The news that Sony has been working on this technology for several years follows a trend set by Google and Samsung. In 2014, Google revealed a high-tech lens to help diabetics measure glucose levels in their tears. Samsung unveiled plans for a smart contact lens that houses a tiny capital. It seems the time when anything and everything can be filmed on the slide is not too far away. The lens would feature a wide-angle zoom and a wide-angle zoom. The lens would feature an angle display, with no need for a wide-angle zoom. But in this case, I'd like to show you something for real. What we see here is an iPhone that's using its camera, but using computer vision, it's actually able to identify surfaces such as this table. And I can actually just add an object. This is a developer application, test application, that you'll all be getting code for that allows you to do these things. Now, this is just a virtual object on this table. Now, I've got some steam in there coming off the cup. Now, I can add other objects to the scene and these things can actually interact. Let's add a lamp. And I want you to watch when I turn the lamp off on the dynamic shadows here. I'm going to move the cup and watch how the shadow moves in relationship to the light here. It's really pretty incredible. Now, I can add additional objects. Let's add a vase. Now, I'm going to add a vase. I'm going to add a vase. I'm going to add a vase. Now, I'm going to add a vase. I'm going to add a vase. I'm going to add a vase. I'm going to add a vase. I'm going to add a vase. I'm going to add a vase. Check the things in 3D space all in real time. In this next shot, we will get to see the whole arm setup and the virtual reality glove that covers all the way down the arm in hand. This allows us to offer to broadcast what we see video-wise as his arm in a shirt sleeve. I have a lot of Tim Peak scripts, but this one here, this system which is a software does not track his hand properly. Tim slips his hand underneath his other fingers, which is tightly holding onto the mic, which is impossible. I don't think this is Tim's fault. Normally, Tim always moves his other fingers up while he slides his hand under. I just think the system didn't respond to his movements here. This picture here is Tim's fault. His hand breaches the 3D mic, folded in front of him. In this next clip, we're going to see Tim's arm slitch out as he's manipulating a 3D bubble. Now, this bubble can be done in real time now. We have the technology to do that, which I showed you at the beginning of this. This bubble is environmentally lit or HDR-I-Lit bias environment, which means the bubble can take up its reflections and refractions as it moves around in 3D space. Tim's augmented reality. Once again, augmented VR just means bringing the 3D objects in our world on a separate monitor. In this last clip, we're going to see NASA royally screw up. It's a live broadcast, and one of their video channels is off, not working. That's the channel that is supposed to show us the public what the astronauts are seeing in virtual reality. Also, the channel shut off is the masking toy the guy on the waters in the background. You can't make this stuff up. Just watch. We all know NASA uses wire, and sometimes we'll catch them like this here. You gotta hold on his wire. However, some days when you're filming live, things just don't work out. It becomes so blatantly obvious. It's ridiculous. So, in this clip, they're parking, light feed, and what you know, we have a astronaut go biased in the background. Obviously, trying to give it a more realistic, spacey, station, busy effect. The only problem is the camera that was supposed to mask this harness out or the video feed is not working. And so, we see the guy come flying along in a harness on his wires. Pretty amazing. But that's not all that goes wrong here. Okay, so you see to the right this guy is flipping this hat. This hat's action on another video channel in 3D space. It's virtual reality. They're wearing augmented contact lenses so that they can interact with these 3D objects. Now, in this scene, the guy on the left in the green shirt, he thinks he sees an object in 3D space. It's being broadcast to him. So, he grabs it, and he puts it off to the side. He's looking straight ahead because he's looking at an object rotating in front of him. But the video channel is down that is supposed to show the viewers what we're supposed to see. And so, we don't actually get to see the object that he is seeing. And I would just sum this up as a very terrible, bad, horrible day for NASA doing live feed. Oh, oh, hey, Tim. Tim, you still there? Yeah. Can you explain to us what this astronaut's going through as he sees something with his eyes in 3D space? But it's not actually there being broadcast to the public. What's going through this astronaut's mind? This system is sending signals to the brain. That doesn't really match your eyes. And so your brain is trying to work out the two differences. Here's the thing. As much fun as this was, there is a time coming when you and I will not be able to tell the difference. And space has not changed. Technology to fake space has gotten better. Just because Dobie gets a massive update to Photoshop or After Effects, or there's a massive updated telemetrics and the virtual reality argumented virtual reality programming. That does not advance as magically 20 years in space. Space has not changed. It's flat. It's above us. It's dimensional. And we cannot orbit Earth. You have been warned. This is very serious stuff. And if you do not get it now, you won't get it later because later you won't know the difference. This is Mike. God bless everybody. Please like and please subscribe. Now this one just blows my mind. You consume into a number of galaxies in our universe. And obviously I've done it to our service system. Now again, when I click to look at more detail on our sun, it's probably the best visual I've ever seen of our sun, including the TV. And I'm hoping this video will do it justice. And you can see the solar flares erupting or shooting out of the sides. Now my favourite planet, like most people, is Saturn. And I had this on yesterday on the train. And it's just so surreal having this 3D planet standing right in front of me. And again, the quality is just amazing. Now check out this 3D shark hologram. And try to keep living my field of view. And look. So now I've made the shark larger. Actually quite scary to have in my fun room. So I'm going to try and keep this in my field of view. And also try and keep relatively still. I have a few years to keep in my field. The quality. So I must for landing the record for the SpaceX Falcon rocket or whatever, that is of course the Falcon 9. And it just landed on someone's pool. Why not? I'm going to try to keep this in my field of view. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice. And I'm hoping this video will do it justice.