As this year's Game Developers Conference (GDC) goes into full swing, Microsoft has detailed some of the tools it is working on to help developers build better games. A big part of that revolves around the Microsoft's efforts with machine learning and how it envisions WindowsML, introduced last week, can play a role in game development. However, Microsoft also gave developers a taste of a new DirectX Raytracing, a new feature of the DirectX API that stands to make games look more realistic.
In terms of machine learning, Microsoft's overview is an aspirational look at how developers will be able to leverage deep neural networks (DNN) to enhance their games. One idea Microsoft envisions for games is using machine learning to naturally adapt to a game to a player's gaming style. For example, a DNN could be used to understand your in-game habits and change things on the fly. "If you're someone who likes to find treasures in game but don't care to engage in combat, DNNs could prioritize and amplify those activities while reducing the amount or difficulty of battles," Microsoft says. "When games can learn and transform along with the players, there is an opportunity to maximize fun and make games better reflect their players."
Outside of gameplay, Microsoft is eyeing machine learning as a tool for improving the development process. Neural networks, the company says, can be leveraged to perform some of the more arduous parts of creating assets and graphics, leaving artists and developers free to focus other areas. This is already in use to some extent: Microsoft points out that the facial animation process that Remedy used with Quantum Break was trained to move characters' faces based on audio input alone. "They reported that this tooling generated facial movement that was 80% of the way done, giving artists time to focus on perfecting the last 20% of facial animation," Microsoft says. "The time and money that studios could save with more tools like these could get passed down to gamers in the form of earlier release dates, more beautiful games, or more content to play."
Visuals can even benefit from machine learning, the company argues. For example, aliasing around objects in games can be smoothed out by tapping into machine learning models to determine the best color for each pixel. This results in an image that is smoother and less jagged when viewed up close. You can see an example of this in the image below, which compares ML Super Sampling (left) to bilinear upsampling (right)
Finally, Microsoft used GDC 2018 to show off a new part of the DirectX API: DirectX Raytracing (DXR). Developers will be able to take advantage of DXR in DirectX 12 to bring real-time raytracing to their games, enhancing some aspects of visual quality today while paving the way for a full replacement of rasterization in the future. From Microsoft:
Today, we are introducing a feature to DirectX 12 that will bridge the gap between the rasterization techniques employed by games today, and the full 3D effects of tomorrow. This feature is DirectX Raytracing. By allowing traversal of a full 3D representation of the game world, DirectX Raytracing allows current rendering techniques such as SSR to naturally and efficiently fill the gaps left by rasterization, and opens the door to an entirely new class of techniques that have never been achieved in a real-time game.
For now, Microsoft says it expects DXR will be used to supplement some rendering techniques, such as space reflections or global illumination. However, DXR could eventually replace rasterization as the standard technique for rendering 3D scenes.
For the average gamer, all of this simply means better-looking games are coming down the pike. For developers, however, you can check out the full technical details at the DirectX blog for more.
We may earn a commission for purchases using our links. Learn more.
The games on Xbox Cloud Gaming that need touch controls
Minecraft Dungeons proved that touch controls and cloud streaming games can work, so we put together a list of the games we think need touch controls as soon as possible.
Join us LIVE for the Windows Central Video Podcast today at 2:30PM ET
We're LIVE with the Windows Central Video Podcast today at 2:30pm ET, make sure you're there!
Windows 10 October 2020 Update review: Subtle, but necessary
Microsoft's next big Windows 10 feature update is almost here, packing several notable changes and enhancements. This release is known as the October 2020 Update, version 20H2, and is the second big Windows 10 update to hit in 2020, after version 2004 which released in May earlier this year. This release is very much a continuation of version 2004, adding a few final touches and subtle...
Up your Fortnite game with one of these great headsets
So you want to up your Fortnite game, do you? One of the easiest fixes is getting yourself a good headset. Whether you play on PC, console or mobile, there's something here for you.