What you need to know
- Microsoft today announced a major breakthrough in automatic image captioning powered by AI.
- Microsoft's new model can describe images as well as humans can through computer vision.
- The company is using the model to improve accessibility across Office apps, its Seeing AI app, and for customers through Azure Cognitive Services.
Microsoft revealed that it has achieved a breakthrough in using artificial intelligence (AI) to automatically caption images. In its tests and a novel object captioning benchmark, Microsoft says its AI model managed to describe images as well as humans can. The model could help improve accessibility across the web and in apps by providing automatic image captions for people with visual impairments.
"Ideally, everyone would include alt text for all images in documents, on the web, in social media – as this enables people who are blind to access the content and participate in the conversation. But, alas, people don't," said Microsoft AI platform group software engineering manager Saqib Shaikh in Microsoft's blog post announcing the breakthrough. "So, there are several apps that use image captioning as way to fill in alt text when it's missing."
Microsoft says this new model is coming to Outlook, Word, and PowerPoint, and it's already being used with its Seeing AI app. Further, Microsoft is bringing this capability to its Azure customers as part of Azure Cognitive Services.
"We're taking this AI breakthrough to Azure as a platform to serve a broader set of customers," said Lijuan Wang, a principal research manager in Microsoft's Redmond research lab, in the blog post announcing the model breakthrough. "It is not just a breakthrough on the research; the time it took to turn that breakthrough into production on Azure is also a breakthrough."
As Microsoft notes in the blog post announcing the breakthrough, this is the latest in a line of AI achievements the company has managed in recent years. The company has also matched human parity in speech recognition, machine translation, conversational question answering, and machine reading comprehension.
We may earn a commission for purchases using our links. Learn more.

Everything you need to know about AMD Radeon RX 6000 GPUs
AMD has unveiled its new lineup of Radeon RX 6000-series graphics cards, with three new pieces of hardware to look forward to. Here's what you need to know.

AMD unveils new Radeon RX 6700 XT GPU
AMD announced the Radeon RX 6700 XT at its hardware event today. The GPU is built on AMD's RDNA 2 architecture. The card competes with some of the best on the market, including NVIDIA's RTX 3060 Ti and RTX 3070.

AMD will announce its next RX 6000-series GPU today; here's how to watch
AMD will hold a hardware event today to announce its next Radeon RX 6000-series GPU. The GPU is expected to compete with some of the best graphics cards on the market and be based on AMD's RDNA 2.

Rechargeable mice are eco-friendly and convenient. These are our favorites
A rechargeable mouse will take the worry out of having your wireless mouse die at the most inopportune moment; the moment you run out of fresh batteries. Charge up your mouse and get to work.