What you need to know
- Microsoft Mesh is a new mixed reality platform that has been years in the making.
- Microsoft Mesh uses Azure, mixed reality, and 3D capture technology to beam a person's lifelike image into a virtual scene.
- Microsoft Technical Fellow Alex Kipman demoed the tech live at Microsoft Ignite.
- James Cameron, Niantic, and Guy Laliberté of Cirque du Soleil are working with Microsoft on the tech.
Microsoft Mesh: 'Holoportation' is getting real
In 2016, Microsoft broke the ice on its new HoloLens mixed reality platform, often demoing potential features that could arrive someday. One of those features was 'holoportation', the ability to be in a shared space with someone else virtually. The concept seemed straight out of Star Trek. Although only a rough demo, it was just two years later Microsoft showed advancements in the idea at Ignite 2019.
Today, holoportation becomes even more real as the Redmond software giant announces Microsoft Mesh (opens in new tab) – a new mixed-reality platform powered by its Azure cloud service. Like its previous holoportation concepts, Microsoft Mesh relies on "3D capture technology to beam a lifelike image of a person into a virtual scene."
The announcement came via a live demonstration of the platform at Microsoft Ignite delivered by Microsoft Technical Fellow Alex Kipman in real-time along with its partners Lune Rouge (Guy Laliberté), Niantic (John Hanke), and OceanX OceanX (Ray Dalio).
On stage, Microsoft and its partners demoed how Microsoft Mesh can enable new abilities and remote collaboration. James Cameron, the famous Hollywood filmmaker, discussed Ray Dalio's OceanX non-profit that "merges cutting edge science with compelling storytelling" to support ocean education and awareness. Collaborating with Microsoft, OceanX is able "to create a Mesh-enabled holographic laboratory" on its research vessel, OceanXplorer. Scientists on the OceanXplorer ship will be able to gather – either in-person or virtually- from labs around the world to see 3D holograms of the areas they're exploring."
Other demos from the CEO and founder of Niantic included a proof-of-concept around Pokémon GO that runs on HoloLens 2. Additionally, Guy Laliberté, founder of Lune Rouge and Cirque du Soleil, spoke about how Microsoft Mesh helped his company bring to life a project called Hanai World that connects "live and digital entertainment experiences into single events."
Turning back to Microsoft's primary mission of productivity, Mesh is also expected to play a significant role in digitizing future workspaces with the benefit of Azure's enterprise-grade security and privacy features:
Of course, the future of actual holograms is not quite here yet, as the company noted people "will initially be able to express themselves as avatars" at first, and then, over time, "use holoportation to project themselves as their most lifelike, photorealistic selves."
Microsoft Mesh: Coming soon (and open standards)
Microsoft Mesh is not just another concept. The new platform brings many of these new features – including "a full suite of AI-powered tools for avatars, session management, spatial rendering, synchronization across multiple users and holoportation" – in the coming months.
Although Microsoft's own HoloLens 2 mixed-reality headset is mainly featured with holoportation, the company noted the platform has "open standards," It will work across many devices, including other virtual reality headsets, smartphones, tablets, and even PCs.
Additionally, Microsoft is announcing the availability of the new Microsoft Mesh app for HoloLens and a new Mesh-enabled AltspaceVR (which Microsoft acquired in late 2017). AltspaceVR with Microsoft Mesh "will allow companies to hold meetings and work gatherings in virtual reality with enterprise-grade security features including secure sign-ins, session management, and privacy compliance."
Microsoft is also letting developers create new applications for the platform and plans to integrate the technology into Microsoft Teams and Dynamics 365.
HoloLens, but better
HoloLens 2 takes everything that made the original great and turns it up to 11. With a new carbon-fiber body, extra padding, eye tracking, and a wider field of view, the headset should have no problem finding success among developers and first-line workers.
Daniel Rubino is the Executive Editor of Windows Central, head reviewer, podcast co-host, and analyst. He has been covering Microsoft here since 2007, back when this site was called WMExperts (and later Windows Phone Central). His interests include Windows, Microsoft Surface, laptops, next-gen computing, and arguing with people on the internet.
Haven't heard Mesh in a while. They love to re-use names. lol.
Hopefully it doesn't end up being called easymesh lol...
I don't understand why they can't use some of this technology to build something to compete with the Oculus.
I've wanted a Hololens since day one, but I can't pay 3,500 for one. :-|
I would be willing to go around a grand though maybe even 1,500 if the specs were good.
Those is one of those things that I'm surprised isn't more prevalent with how popular VR and AR is nowadays.
VR is niche type product, companies are seeing if they can create a market. AR is a niche in a niche, eventually will be rolled into VR. Unless the glasses are normal sized glass, limited audience. They are not popular, although money keeps slowly moving into VR development. The problem is over selling ideas, nothing wrong with any of this... they are niche though. Microsoft has money to burn though.
Remember when Eddington would show up on the bridge of the Defiant in holographic form to mock Captain Sisko and his hypocritical Federation morals? Helluva literary device. Got old, though.
Damn, I love it!!
I want to see a full documentary showcasing the tech on that research ship :)
good luck getting Apple devs or Google devs to support it. the platform wars are always active. besides, they don't want to support multiple platforms (an Apple dev can survive only supporting iOS). and if the idea is good enough, Apple and Google will do their own version so that their devs stay within their garden. that said, I'm excited by the idea. but because of the monopsonies that exist, it's really hard to break in.
How do we find the "AltspaceVR with Microsoft Mesh?" Is it publicly available?
@waynejk Here you go... 😅 https://altvr.com/mesh/
“Holoportation is now a reality” vs “Of course, the future of actual holograms is not quite here yet“ LOL
You also don't have a HoloLens 2 ...
Microsoft *really* needs to stop calling 3D models in AR/VR “holograms”. They just aren’t. Even when projected onto a hololens display, they *still* aren’t holograms. Just a fancier version of the Pepper’s Ghost illusion (image projected on glass). Real holograms are very different. https://en.wikipedia.org/wiki/Holography
Get the best of Windows Central in in your inbox, every day!
Thank you for signing up to Windows Central. You will receive a verification email shortly.
There was a problem. Please refresh the page and try again.