LIV repurposes Kinect for mixed reality capture without a green screen

Kinect (Image credit: Matt Brown | Windows Central)

Kinect may no longer be a staple of the Xbox experience, but developers are still figuring out how to use it in unique ways. That includes LIV, a company focused on making video capture for VR experiences more accessible, which recently figured out how to repurpose Kinect to capture mixed reality footage without the need for a green screen.

LIV already provides green screen cubes that allow broadcasters to insert themselves into captured VR footage while playing games, making for an experience that's a bit more unique than seeing a pair of floating hands on screen. With Kinect, however, broadcasters may soon be able to ditch the green screen altogether.

LIV recently showed off its setup in action with Beat Saber, a hectic music game that is integrated with LIV's SDK. Check it out below:

See more

The experience is still very much a work in progress, and it only supports the Kinectv2 unit and Oculus Rift for the moment. Support for additional depth-sensing cameras could be added in the future. But for those with a Kinect and a VR headset lying around, you can learn more about getting set up on LIV's Discord server.

While Kinect is essentially dead for Xbox at this point, it's cool to see what developers are still cooking up with the camera's depth-sensing capabilities. As for Microsoft, the company recently announced that Kinect's legacy will live on with Kinect for Azure, a tool built for ambient computing applications. That includes the next version of HoloLens, which will be equipped with the new Kinect sensor bundle.

Dan Thorp-Lancaster

Dan Thorp-Lancaster is the former Editor-in-Chief of Windows Central. He began working with Windows Central, Android Central, and iMore as a news writer in 2014 and is obsessed with tech of all sorts. You can follow Dan on Twitter @DthorpL and Instagram @heyitsdtl

  • Microsoft should use the Kinect as an external sensor for WMR, to assist with tracking loss when the controllers go behind the player's head or drop to the player's arms. It makes so much obvious sense to do this. It doesn't NEED to be a part of the system, but it's an already existing device that would lessen the biggest drawback of WMR.
  • Okay, that kind of innovation is cool. And to see there's potential life for the Kinect many still have is also cool. Sadly, I find watching other people play a video game just as boring as I find watching any sporting event. Boring to tears. Hopefully, we'll see some other kinds of uses for the Kinect where VR is concerned. This seems promising (which means Microsoft will likely kill it).
  • Still, it's a multi-million if not billion dollar business, watching other people game
  • In anticipation of xbox one X purchase, I've looked into modding the connector so I don't have to buy an overpriced adapter.
    Looks easy enough. I won't let it go because voice commanding is so useful.
  • That's what I used it for, voice commands, just simply controlling movies and music with my voice was incredible.
  • I prefer Kinect in my living room to Alexa invoke or gh. We have invoke in the kitchen and kids bedroom. And my always listening tablet in my bedroom. I use Cortana with my cars voice command button triggering her on my phone over the car speakers. I have not yet once said. Damn I wish I had an Alexa. Now with this Cortana Alexa thing. I won't have to.