When a small Microsoft Garage team began working on "Lookout, an AI-powered tool for monitoring live video streams, they had no idea it would eventually end up as an important part of Microsoft's Mixer streaming service. But, after winning the 2017 Microsoft Hackathon, the tool, now known as "Watch For," became the backbone of Mixer's HypeZone.
In a new post on the Microsoft Garage blog, the company takes a look behind the curtain of HypeZone, offering details on Watch For's humble journey from Garage project to game-streaming success.
At its inception, Watch For was designed by a Microsoft researchers Matthai Philipose, Lenin Sivalingam, Yifan Wu, Peter Bodik, and Victor Bahl. With a background in working on video analytics for the enterprise sector, the team began work on Watch For as a way to translate their experience to apply AI to a consumer setting. Over time, Microsoft CEO Satya Nadella took notice of the team, and their project eventually won Microsoft's annual Hackathon in 2017.
From there, the Mixer team was intrigued by Watch For and reached out for a potential collaboration. The goal was to use Watch For's AI smarts to hone in on the most exciting moments from new battle-royale style games like PlayerUnknown's Battlegrounds (PUBG) and Fortnite, which were surging in popularity. This gave birth to HypeZone.
Matt already had the idea of HypeZone itself, to switch from stream to stream within a channel – but the experience of HypeZone evolved very quickly during our collaboration. We met with Matt and Chad early September. Two weeks later we had a prototype that we showed them. Then we kept improving its accuracy. By mid-October we had another prototype that they could use to run their HypeZone experience. We tested it for another 3 weeks. Then, 2 days before release, PUBG changed their UI. 1 day before release, we had to completely change all our models.
HypeZone is driven by Watch For's large-scale video analysis of every stream that's coming into Mixer. Every stream we try to understand what's on the screen. We look for various metadata that tell us the game is exciting. Text on the screen, icons that tell you state of the game, player stats and score. Over time we have evolved to understand more and more.
Today, Mixer's HypeZone has expanded to offer 24/7 channels that deliver down-to-the-wire action from PUBG, Fortnite, and Rainbow Six Siege.
For more on the story of Watch For's journey, check out the full blog post at Microsoft.
We may earn a commission for purchases using our links. Learn more.
Review: Pistol Whip 2089 VR is an awesome and exciting experience
It's the age-old tale of man versus machine in Pistol Whip 2089, a free update to the immensely popular VR rhythm shooter that adds in brand new weapons, enemies, music, and a story mode complete with boss fights.
Best Microsoft Surface Cyber Monday Deals: Surface Pro 7 down to $600
Microsoft's Surface lineup has grown by leaps and bounds over the years. Whether you're looking for the newest Surface Pro X or Pro 7 or are willing to settle for a previous generation at an even more discounted price, we've got all the best deals you're going to find around the 'net right here.
These are the best deals on Xbox consoles you'll find this month
If you're in the market for a new Xbox One console, you'll want to check these deals out first.
Make the most of your Surface Pen and Slim Pen with these awesome apps
To really maximize the ability of the Surface Pen and Slim Pen, there are some essential apps you should check out. We've rounded up the best right here for a variety of purposes.