What a Star Wars esque game could look like on HoloLens

Well, for sure there'll be stand-alone HoloLens games, but games that offer trans-screen experiences between HoloLens or PC will have a lot of appeal.

Say you've got a game that has Xbox/HoloLens integration - you're getting a lot more than just a screen. You're getting a natural and familiar input scheme, and (more importantly) a lot more processing power.

Think of it like a host/client connection between Xbox and HoloLens - Xbox constantly streaming x,y,z,v of the holographic elements to be rendered by HoloLens. You have all the benefits of a game on a big screen, but with elements extended beyond the screen.

One of Microsoft's HoloLens-related patents notes that an added benefit of the opacity filter used to mask out real world light behind the AR elements to make them seem solid is that it can be driven to make the headset simultaneously function as active shutter glasses for a 3D television.

Taken all together, think of what you could do with all these elements. You've got a game console that can fill the screen up with pretty graphics, and a Kinect unit so it sees the room and knows where the player is. You've got the HoloLens providing pinpoint head tracking and also mapping the play the space.

So the game world is rendered on screen, and it crosses over into the real world. They are mapped together to create a seamless space. Because the game knows exactly where the player's head is, the on-screen world is rendered from the correct point of view, making it appear as though you're looking through a Window. (Like this, if that seems obscure.) If you have a 3D television, this illusion can be further enhanced by using the HoloLens' shutterglass feature.

So you're walking around your livingroom with a controller in hand. The enemy base is rendered in the TV. Your base is on coffee table - or maybe the couch - wherever you've placed it. Game is half choplifter, half tower defense. You place your turrets and defenses around the room. You use the controller to fly a helicopter out of the base, pick up soldiers at the barracks you've built on the floor, fly into the television, evade the enemy AA, dogfight the enemy copter, drop your grunts off for a raid, let loose some vulcan missles, tear out and get back to your base for repairs, oh, damn they snuck in and they're tearing up your base. Clean that up! Oh, and that beautifully-rendered world on the other side of the TV is abstracted from the online player's living-room. When you fly in to the TV, he sees your heli fly out.

That's one hypothetical scenario - but the point is, games that will use Xbox (or PC) + HoloLens have a lot of potential.

/r/HoloLens Thread Link - youtube.com