Exclusive: Microsoft may bring AI capabilities to apps like Paint and Photos on Windows 11

An internal mock-up of Microsoft Paint with AI. (Image credit: Windows Central)

What you need to know

  • Microsoft is experimenting with different ways of bringing AI capabilities to Windows.
  • Such experiments include bringing OCR to apps like Snipping Tool, Camera, and Photos.
  • Microsoft is also toying with the idea of bring generative AI to the Paint app.

This past year has been significant for Microsoft and AI, with almost all new product announcements having some tie-in to an AI-related functionality. Now, even Windows is getting in on the fun with Windows Studio Effects and the upcoming Windows Copilot, announced a few months ago and expected to ship this fall.

But those aren’t the only areas that Microsoft is exploring in adding AI to Windows 11. According to my sources, the company has been toying with bringing AI capabilities to a handful of in-box Windows 11 apps, including Photos, Snipping Tool, and Paint. Some of this functionality will require dedicated hardware, such as an NPU (neural processing unit) or VPU (vision processing unit,) while others may not.

For the Photos app, Microsoft is working on an AI functionality that would allow the app to identify objects or people in photos and enable the ability to cut out and paste those elements elsewhere. This is a functionality that iOS and Android have had for some time, so it’s no surprise to hear that Microsoft is also working to bring it to Windows.

An internal build of the camera app with OCR capabilities.  (Image credit: Windows Central)

Regarding the Snipping Tool, my sources say the company wants to incorporate OCR (optical character recognition) technology to enable Windows to identify text in screenshots for faster clipboard copying. Microsoft is also working on bringing OCR to the Camera app, allowing users to select text in a photo taken on the device.

Lastly, my sources say Microsoft has also been experimenting with bringing generative AI to the Windows 11 Paint app. Users could ask Paint to create a canvas based on criteria set out by the user, similar to how Bing Image Creator currently works. A new "background removal" feature is also on the cards. 

It’s unclear when or if Microsoft will soon ship these AI integrations on Windows 11. My sources say these ideas are still in experimental stages as the company sets out how to incorporate more AI capabilities into Windows. Microsoft is holding an event on September 21, where I’m told it will announce new Surface hardware and further discuss AI in Windows.

I also understand that the next major platform release of Windows, coming in 2024, is expected to incorporate AI more significantly. Right now, the AI capabilities Microsoft is working on for Windows 11 are somewhat surface-level. My sources say the next major release will be where the company begin integrating AI experiences more deeply.

I’ll have more to share on that topic soon, but for now, are you excited about Microsoft’s AI plans for Windows 11? Let us know by adding a comment below!

Zac Bowden
Senior Editor

Zac Bowden is a Senior Editor at Windows Central. Bringing you exclusive coverage into the world of Windows on PCs, tablets, phones, and more. Also an avid collector of rare Microsoft prototype devices! Keep in touch on Twitter and Threads

Read more
The HP OmniBook Ultra Flip 14 (2024) on a desk and in tablet mode, showing Microsoft Paint open with an amateur drawing and HP's MPP2.0 stylus.
This Microsoft app is the latest to get infused with Copilot
Photos app on Windows 11
Windows 11's Photos app is about to get a big update, and it's all about AI
Windows 11 Snipping Tool with emoji
I use this Windows 11 app every day, and I can't wait to use its upcoming feature
Share UI with image editing tools
Windows 11's built-in share tool is getting an image editor and compression feature
A pre-production sample of the HP EliteBook Ultra 14 (G1i), open and sitting on a desk.
Copilot+ PCs will soon get their first must-have exclusive feature
Windows 11 Search
Copilot+ PCs' first must-have feature is just around the corner
Latest in Windows 11
Photo of Microsoft's new sign-in page for Xbox.com using the Microsoft Edge browser.
Over one billion users will get a new Microsoft user experience, and it has a dark mode
Windows 11 answer file
How to easily create an unattended answer file for Windows 11
Windows Update
Microsoft begins testing next phase of Windows 11 — Dev Channel to flight new platform changes
Windows 11 Search
Copilot+ PCs' first must-have feature is just around the corner
Themes section of the Microsoft Store on Windows 11
Two of my least favorite things about the Microsoft Store are about to get fixed
Surface Laptop 7
Amazon warns Surface Laptop 7 shoppers as Mojang unveils massive visual update to Minecraft and Microsoft leaks a potential new feature for the Xbox app on Windows 11
Latest in News
Screenshot of Assassin's Creed Shadows.
Assassin's Creed Shadows crosses 3 million players just a week after launch
The Backbone One Xbox Edition mobile controller which is translucent green
Backbone launches Xbox version of its popular mobile controller — it's green!
Office 365 on Razer laptop
Microsoft Office apps are about to get a speed boost
NVIDIA CES 2025
You should be worried about NVIDIA’s launch strategy for its most popular GPUs. Here's why.
Two hands holding a gaming handheld
This new gaming handheld could be perfect for Xbox Cloud and more reasonably priced than my current go-to
Cloud servers
Microsoft has killed "several" data center projects in the U.S. and Europe, according to reports — Microsoft responds (Updated)