View the demo
by Scott D'Angelo | Updated May 14, 2018 - Published December 13, 2017
Artificial intelligenceConversationSpeech and empathyVirtual realityGaming
This developer pattern will show you how to build advanced interactive speech systems for virtual reality with just two Watson™ services: Watson Speech-to-Text for transcription and Watson Assistant for parsing the meaning of the words. Discover how to leverage the Watson Unity SDK to implement the services right from the Unity development environment.
Virtual reality (VR) enables users to feel like they truly inhabit a different space. In a VR environment, speech is a more natural interface than other methods for certain interactions. You don’t want to pause an experience to stare at a control or, heaven forbid, type a command; you want to be in the moment. The ability to simply speak instructions keeps you in that moment and helps provide an entirely new dimension of immersion for users.
By learning how to add speech controls to VR environments, you can build more richly interactive, immersive experiences – and position your own skills for the next big technology revolution. When you complete this developer pattern, you will understand how to add IBM Watson Speech-to-Text and Assistant services to a virtual reality environment built in Unity, the popular 3D development platform.
There are several popular VR head-mounted devices that offer users powerful immersive experiences. Their popularity and versatility make them ideal candidates for speech interaction. This developer pattern shows you how to implement speech controls for Google Cardboard, HTC Vive, and Oculus Rift, three of the most popular head-mounted VR devices.
July 17, 2019
June 6, 2019
April 13, 2019
Back to top