Skip to main content

You can control your PC with your eyes with the Windows 10 Fall Creators Update (video)

Starting with the Windows 10 Fall Creators Update, Microsoft is introducing a new accessibility feature that allows users to control their PC's with just their eyes. Using third party hardware like the Tobii Eye Tracker 4C (opens in new tab), you will be able to navigate your Windows 10 PC with just your eyeballs, including the ability to manipulate windows, type out sentences and more.

Microsoft is now testing this new eye tracking technology with the latest Windows 10 Insider Preview builds, and will be available for the public when the Fall Creators Update begins its rollout. We've gone eyes on with the new eye tracking features to show you what it's all about.

In our quick demo, we showcase the work Microsoft has been doing natively to Windows 10 in the ease of access space, as well as showcase the work Tobii has been doing to via its third party software to enhance the experience of using a PC with a mouse and keyboard.

This technology is truly fascinating. The work Microsoft is doing specifically is designed with those who may not be able to move around as freely as others in mind. For example if you're someone who is unable to comfortably use a mouse or use a keyboard, being able to control your PC with your eyes is a helpful alternative for input.

Of course, this technology is also useful in other situations too. If you're a chef in a kitchen, and have messy hands from all that cake mix you've been mixing, instead of cleaning your hands to interact with your PC and read the recipe you're following, you can just use your eyes to get what you need done instead.

Microsoft says they will be adding support for more eye tracking hardware in the future. For now however, it works with hardware from Tobii, such as the Eye Tracker 4C. You can grab one for yourself from Amazon for $150. (opens in new tab)

See at Amazon (opens in new tab)

Zac Bowden is a Senior Editor at Windows Central. Bringing you exclusive coverage into the world of Windows 10 on PCs, tablets, phones, and more. Also an avid collector of rare Microsoft prototype devices! Keep in touch on Twitter: @zacbowden.

35 Comments
  • This blew my mind, I'm absolutely shocked. I did not expect this to work so fast and that well. I'm not disabled but shut and take my money!
  • Evolution
  • My exact reaction after watching the video, when I read the title I was like "pfft.. this will be really sloppy.", but damn son.
  • This is really cool, and it's got me thinking.  I wrote a couple of posts in Jason's article about how I couldn't possibly see augmented reality technology replacing phones because of issues with input technology.  With phones, you have touch and maybe stylus which are low movement and relatively private, but with an augmented reality headset like hololens, you'd have inputs like voice and touch - loud and large movement and not suited to public use.  But if you had a hololens-type headset with eye tracking tech like this......
  • Please check this video with Tobii Eye Tracking integration into VR (HTC Vive retrofit) https://youtu.be/eBINRku82hA
  • Very nice. How did you do the clicks on the keyboard?
  • He pauses there for a second on the appropriate key and it clicks for him.
  • Wow! I'll be sure to use this! What's amazing is that it's still in its trial phase and it's this smooth and fast.. Also, the hardware (tobii) is pretty slick looking, it can easily be put in the next gen laptops and tablets. MSFT, buy the company now!!! Buy Tobii before one of your rivals gets to them
  • Very cool demonstration! Although I probably won't use it myself, I'm glad to see MS supporting this technology.
  • Check how Tobii Eye Tracking enhances experience in games. This videos shows how it works in Ghost Recon Wildlands - https://youtu.be/TX0J0isogVA
  • Now all of a sudden it makes sense that Alienware includes Tobii tracking in their gaming laptops.  
  • How long before it starts tracking which side banner ad's you are looking at and then pushing more of them to you?
  • If we must see ads better that they are relevant for us I guess.
  • Ad block means no banner ads on my screen lol.
  • Then how do you support the sites you enjoy?
  • When sites build ads that are not invasive (windows central is the worst of them all btw) ill be happy to turn off ad blocker. Until then, I'll enjoy visiting sites with internet I already pay for.
  • Microsoft is not Google.
  • LOL, thay are under Nadella; long gone are the days when Microsoft could live up to the Scroogled campaign, now Microsoft is data mining just like google (if not worse) direct from your Win10 OS.  
  • It looks like... eyeOS
  • Yes lol! You win sir.
  • I'm not impressed with eye login on my Lumia 950. Works great in well-lit areas, but always fails in low-light.
  • This is something very different though.
  • Very innovative.
  • May have to buy one look pretty sweet
  • OMG!!! This is insane! Love it! 😍💗
  • Ok, this could be a selling point for the, hopefully, upcoming W10 phones.
  • No.
  • Wish I could Left Click and Right Click w.r.t Blinking my Left Eye and Right Eye 😁
  • Nice. My Eye Tracker 4C will finally become useful outside of gaming. ;) 
  • i have to admit that the first thing that came to my mind was that i definitely will need some time to adjust my behavior bc i used my pc differently for years(i dont even have a touch laptop, bc i cannot afford one). and since im only 22 this might be a bit of a steep learning curve, thinking about even older people. but then, in a very short time, i realised that even if a use my pc differently for far more than 10 years i still can adjust quite easily (a year maybe, esp since im quite a geek myself) and also realised how we live in the future with all this AR, VR, fingerprint/face/retina auth on our devices, and now even controlling them with eyes(bc yea voice will never be a usage scenario that will be used for more than just small things eg reminders, due to obvios reasons like ppl hearing us). so yea, future is great and today kids are going to use devices very very differently than us.
  • Control PC with eyes... Lol
    It's useless as control with the dick
  • Is this viable for regular users who are looking for a mouse alternative? For example people who want to keep two hands on a keyboard without having to keep taking one off to use a mouse?
  • Actually, yes. In the video, Zac demonstrated a feature where you could look at a text field briefly and just start typing. Also, he showed a feature where the mouse would suddenly move to where you're looking when your finger touches a touchpad. So on a laptop keyboard, that would be ridiculously useful. As for my own use case, I saw this video a few months back and my baby has been getting more and more difficult to hold while trying to use my PC, so I'm considering getting one of these trackers so my hands and arms can focus on holding my baby securely for random stuff when putting her into a carrier is just too much trouble.
  • Be a godsend for people like Stephen Hawking... well done, MS.
  • This looks brilliant but can easily see Apple "inventing" consumer uses of this and being credited with "revolutionizing" computing yet again.