'Holoportation' is now a reality thanks to Microsoft Mesh, Azure, and HoloLens 2

Alex Kipman with HoloLens 2
Alex Kipman with HoloLens 2 (Image credit: Microsoft)

What you need to know

  • Microsoft Mesh is a new mixed reality platform that has been years in the making.
  • Microsoft Mesh uses Azure, mixed reality, and 3D capture technology to beam a person's lifelike image into a virtual scene.
  • Microsoft Technical Fellow Alex Kipman demoed the tech live at Microsoft Ignite.
  • James Cameron, Niantic, and Guy Laliberté of Cirque du Soleil are working with Microsoft on the tech.

Microsoft Mesh: 'Holoportation' is getting real

In 2016, Microsoft broke the ice on its new HoloLens mixed reality platform, often demoing potential features that could arrive someday. One of those features was 'holoportation', the ability to be in a shared space with someone else virtually. The concept seemed straight out of Star Trek. Although only a rough demo, it was just two years later Microsoft showed advancements in the idea at Ignite 2019.

Today, holoportation becomes even more real as the Redmond software giant announces Microsoft Mesh (opens in new tab) – a new mixed-reality platform powered by its Azure cloud service. Like its previous holoportation concepts, Microsoft Mesh relies on "3D capture technology to beam a lifelike image of a person into a virtual scene."

Microsoft Mesh is the result of years of Microsoft research and development in creating persistent holograms.

The announcement came via a live demonstration of the platform at Microsoft Ignite delivered by Microsoft Technical Fellow Alex Kipman in real-time along with its partners Lune Rouge (Guy Laliberté), Niantic (John Hanke), and OceanX OceanX (Ray Dalio).

On stage, Microsoft and its partners demoed how Microsoft Mesh can enable new abilities and remote collaboration. James Cameron, the famous Hollywood filmmaker, discussed Ray Dalio's OceanX non-profit that "merges cutting edge science with compelling storytelling" to support ocean education and awareness. Collaborating with Microsoft, OceanX is able "to create a Mesh-enabled holographic laboratory" on its research vessel, OceanXplorer. Scientists on the OceanXplorer ship will be able to gather – either in-person or virtually- from labs around the world to see 3D holograms of the areas they're exploring."

Microsoft Mesh Kipman Ignite

Source: Microsoft (Image credit: Source: Microsoft)

Other demos from the CEO and founder of Niantic included a proof-of-concept around Pokémon GO that runs on HoloLens 2. Additionally, Guy Laliberté, founder of Lune Rouge and Cirque du Soleil, spoke about how Microsoft Mesh helped his company bring to life a project called Hanai World that connects "live and digital entertainment experiences into single events."

Pokemon Go Microsoft Mesh

Source: Niantic (Image credit: Source: Niantic)

Turning back to Microsoft's primary mission of productivity, Mesh is also expected to play a significant role in digitizing future workspaces with the benefit of Azure's enterprise-grade security and privacy features:

Microsoft Mesh will also enable geographically distributed teams to have more collaborative meetings, conduct virtual design sessions, assist others, learn together and host virtual social meetups. People will initially be able to express themselves as avatars in these shared virtual experiences and over time use holoportation to project themselves as their most lifelike, photorealistic selves.Architects and engineers could physically walk through a holographic model of a factory floor under construction, seeing how all the pieces of equipment fit together in three dimensions, potentially avoiding costly mistakes.Engineering or medical students learning about electric car engines or human anatomy could gather as avatars around a holographic model and remove parts of the engine or peel back muscles to see what's underneath. Colleagues could simply get together and chat in a shared virtual space, or companies could use Microsoft Mesh-enabled apps to offer virtual all-hands meetings or trainings to employees around the world.

Of course, the future of actual holograms is not quite here yet, as the company noted people "will initially be able to express themselves as avatars" at first, and then, over time, "use holoportation to project themselves as their most lifelike, photorealistic selves."

Microsoft Mesh: Coming soon (and open standards)

Altspacevr Logo

Source: Microsoft (Image credit: Source: Microsoft)

Microsoft Mesh is not just another concept. The new platform brings many of these new features – including "a full suite of AI-powered tools for avatars, session management, spatial rendering, synchronization across multiple users and holoportation" – in the coming months.

Although Microsoft's own HoloLens 2 mixed-reality headset is mainly featured with holoportation, the company noted the platform has "open standards," It will work across many devices, including other virtual reality headsets, smartphones, tablets, and even PCs.

Additionally, Microsoft is announcing the availability of the new Microsoft Mesh app for HoloLens and a new Mesh-enabled AltspaceVR (which Microsoft acquired in late 2017). AltspaceVR with Microsoft Mesh "will allow companies to hold meetings and work gatherings in virtual reality with enterprise-grade security features including secure sign-ins, session management, and privacy compliance."

Microsoft is also letting developers create new applications for the platform and plans to integrate the technology into Microsoft Teams and Dynamics 365.

Daniel Rubino

Daniel Rubino is the Editor-in-chief of Windows Central, head reviewer, podcast co-host, and analyst. He has been covering Microsoft since 2007 when this site was called WMExperts (and later Windows Phone Central). His interests include Windows, laptops, next-gen computing, and for some reason, watches. Before all this tech stuff, he worked on a Ph.D. in linguistics, watched people sleep (for medical purposes!), and ran the projectors at movie theaters because it was fun.

  • Haven't heard Mesh in a while. They love to re-use names. lol.
  • Hopefully it doesn't end up being called easymesh lol...
  • I don't understand why they can't use some of this technology to build something to compete with the Oculus.
    I've wanted a Hololens since day one, but I can't pay 3,500 for one. :-|
    I would be willing to go around a grand though maybe even 1,500 if the specs were good.
  • Those is one of those things that I'm surprised isn't more prevalent with how popular VR and AR is nowadays.
  • VR is niche type product, companies are seeing if they can create a market. AR is a niche in a niche, eventually will be rolled into VR. Unless the glasses are normal sized glass, limited audience. They are not popular, although money keeps slowly moving into VR development. The problem is over selling ideas, nothing wrong with any of this... they are niche though. Microsoft has money to burn though.
  • Remember when Eddington would show up on the bridge of the Defiant in holographic form to mock Captain Sisko and his hypocritical Federation morals? Helluva literary device. Got old, though.
  • Damn, I love it!!
    I want to see a full documentary showcasing the tech on that research ship :)
  • good luck getting Apple devs or Google devs to support it. the platform wars are always active. besides, they don't want to support multiple platforms (an Apple dev can survive only supporting iOS). and if the idea is good enough, Apple and Google will do their own version so that their devs stay within their garden. that said, I'm excited by the idea. but because of the monopsonies that exist, it's really hard to break in.
  • How do we find the "AltspaceVR with Microsoft Mesh?" Is it publicly available?
  • @waynejk Here you go... 😅 https://altvr.com/mesh/
  • “Holoportation is now a reality” vs “Of course, the future of actual holograms is not quite here yet“ LOL
  • You also don't have a HoloLens 2 ...
  • Microsoft *really* needs to stop calling 3D models in AR/VR “holograms”. They just aren’t. Even when projected onto a hololens display, they *still* aren’t holograms. Just a fancier version of the Pepper’s Ghost illusion (image projected on glass). Real holograms are very different. https://en.wikipedia.org/wiki/Holography