Microsoft can now detect if you are happy, sad or angry in photos

Microsoft's Project Oxford series of facial recognition APIs can already try to detect how old a person is in a photo or if they have a twin. Now a new update to those tools can detect a person's emotions in photos, including happiness, sadness, or anger.

Microsoft says:

"In the case of something like facial recognition, the system can learn to recognize certain traits from a training set of pictures it receives, and then it can apply that information to identify facial features in new pictures it sees.""The emotion tool released today can be used to create systems that recognize eight core emotional states – anger, contempt, fear, disgust, happiness, neutral, sadness or surprise – based on universal facial expressions that reflect those feelings."

Such a tool might be useful for a business who wants to find out a person's reaction to a store display, a movie or product. The emotion tool is currently available for developers to try out now as a public beta on the Project Oxford website. Another tools that is also being released today is for spell checking:

"This spell check tool, which developers can add to their mobile- or cloud-based apps and other products, recognizes slang words such as "gonna," as well as brand names, common name errors and difficult-to-spot errors such as "four" and "for." It also adds new brand names and expressions as they are coined and become popular."

Other Project Oxford tools will be released by the end of the year, again as public betas. They will include ways to analyse and automatically edit video clips, a voice recognition tool and updates to the current facial recognition tools for features like facial hair and smile prediction.

Source: Microsoft (opens in new tab); Project Oxford

John Callaham
  • Cool!
  • Well, I've seen tracking tech that doesn't track black folks. I also see we got some white folks in the photo....hmmm. So, who knows?
  • ?
  • Wow really? That's where you go first on this? Racist much?
  • Uhmm, first of all, look it up moron. It's true. Tracking software did not work well, if at all, for black folks. Second of all, I'm brown too...look at my picture.
  • Super cool
  • What if its a mixed bag of emotions :D:(:/
  • the output is like this "Scores": {
          "Anger": 3.784958e-9,
          "Contempt": 2.17644625e-10,
          "Disgust": 8.470069e-9,
          "Fear": 1.8734023e-11,
          "Happiness": 0.99999994,
          "Neutral": 2.52160586e-8,
          "Sadness": 3.50126363e-8,
          "Surprise": 1.243408e-10
        } so throw whatever you want at it.
  • Lol
  • Kinda creepy but cool.
  • Cheap tricks to stay in news
  • You read it. SMH Posted via the Windows Central App for Android
  • Sounds amusing, but still interesting.
  • "You are an old, angry man (or a very ugly woman), with a ridulous mustache. Stop trying to be a hipster and cheer up, mate!"
  • Can this be marketed before Samsung or Apple steals the thunder?
  • It should be in form of app
  • No need for Windows Phone app.
  • How about linking this to Cortana through the front camera, then she can make suggestions based on your mode
  • Interesting idea, emperor_skull.
  • I had good results with the age calculating page, the twins or not page, even the moustache page but this doesnt seem to work.
  • Masterminding.
  • Nice
  • Too much plastic surgery can produce constantly surprised results.
  • Lol
  • Cool I hope that app never be released for android and IOS
  • this wouldnt work on me cause my face doesnt change that much when im surprised or happy lol. im not just randomly smiling for no reason at my computer
  • What about faking a face? Lots of people do that for photos.
  • Can't wait till it detects when I'm stoned....