Microsoft researchers develop VR 'canetroller' for the visually impaired

VR is traditionally thought of as an immersive visual medium, but Microsoft Research has developed a novel way to give visually impaired users a way to interact with VR as well. As spotted by The Next Web, researchers at Microsoft recently what they call the "canetroller," (opens in new tab) a device that uses haptic feedback to help the visually impaired navigate a virtual environment.

According to Microsoft, the canetroller simulates the experience of using a white cane in the real world, only in VR. Working with an HTC Vive headset, visually impaired users can use the canetroller translate the white cane skills they've already acquired to participate in VR experiences.

The canetroller operates based on three different types of feedback. The first is that a brake mechanism can physically impede the controller to provide physical resistance when the cane contacts a virtual object. Next, the cane can provide "vibrotactile feedback" to simulate vibrations when the cane hits an object or is dragged scross surfaces. Lastly, the cane can simulate the sound of real-world use with 3D auditory feedback.

The project is still a work in progress and will require further refinement, but it shows promise, particularly in helping to individuals with visual impairments learn to travel confidently through various environments. According to the researchers, orientation and mobility instructors saw the canetroller as a particularly useful tool for helping individuals practice crossing busy streets.

It can be used with students who might be nervous about crossing a particular busy street. Let's try it this way first… without having the risk of hitting by [a] car.

Microsoft's efforts on accessibility and inclusion have recently garnered increased attention, and the company even recently received the Helen Keller award from the American Foundation for the Blind. It's interesting to see researchers pushing forward to make such a traditionally visual medium more accessible, and it will be interesting to see what potential the canetroller may have as it is refined further.

Dan Thorp-Lancaster

Dan Thorp-Lancaster is the former Editor-in-Chief of Windows Central. He began working with Windows Central, Android Central, and iMore as a news writer in 2014 and is obsessed with tech of all sorts. You can follow Dan on Twitter @DthorpL and Instagram @heyitsdtl

  • Good stuff.
  • They showed a lot more walking than the average VR demo. Hopefully they can adapt this so the user can glide around virtually and explore.
  • I think that we need to stop looking at building different "controllers" and build gloves (despite this giving me flashbacks to nintendo's power glove).  The key thing is going to be making sure that it breaths well (nobody likes sweaty hands).  Once they get the glove figgured out they could give you simple pieces of plastic to use as "controllers" for the different games (maybe have a usb port on the gloves for plugging in different controllers if they have their own sensor requirements or to feed in the specification information to the gloves?). I just think this is a more universal way to address the problem.