IBM and Unity are bringing the power of AI to the Unity community. Earlier this year, at INDEX 2018, IBM announced a partnership with Unity to launch the IBM Watson Unity SDK on the Unity Asset Store. This SDK is the first asset of its kind to bring scalable AI services to Unity, enabling developers to easily integrate Watson services such as visual recognition, speech to text, and language classification into their Unity applications. Millions of Unity developers globally now have access to the powerful cloud-based AI services of Watson directly within the Unity environment.

Building the future of enterprise AR and VR together

Although AR and VR are continuously being applied to the gaming industry to immerse players in virtual environments like galaxies or with geolocation environments where the activity happens on real surroundings, these concepts are now being applied to business use cases. For example, with VR, companies can implement employee training programs that teach workers how to perform a job in a virtual environment without any safety risks. With AR, field workers can point their phone or glasses to a pipe to see if it needs to be fixed, when, and where.

As AR and VR technologies mature, there is increasing interest coming from enterprise markets for innovative applications in marketing, design, engineering, manufacturing, and analysis. Unity is the market leader in AR and VR for consumer use cases and is rapidly emerging as the market leader for enterprise AR and VR.

Bringing data to life with IBM Immersive Insights.

With our deep AI expertise and industry knowledge, we are also actively exploring the application of AR and VR with clients such as the Immersive Insights demo, which hints at the enormous potential of AR and VR in enterprise applications. Together, IBM and Unity plan to help drive the development of this market by enabling applications that bring contextual expertise and AI capabilities directly into the employee and end consumer’s personal and professional sphere of experience.

This partnership exemplifies IBM and Unity’s commitment to accelerating the enterprise developer journey and equipping them with the tools and resources they need to build powerful new AR and VR apps. As an official gold sponsor for the Unite Japan conference next week in Tokyo, we’re excited to collaborate with Unity to empower the Unity community with powerful AI-driven cloud services to help expand a new frontier of interactivity.

IBM Watson Unity SDK

With the SDK now available on the Asset Store, Unity developers can now configure games and projects to understand speech, talk with users, and understand the intent of a user in natural language.

One of the key features of the SDK is its powerful speech recognition capabilities. With speech services, developers have access to real-time speech recognition providing highly accurate speech recognition directly in your Unity project. Player speech can be recognized and used to trigger in-game events. The IBM Watson Unity SDK also has powerful language translation and language classification capabilities. Both language classification and speech recognition can work together seamlessly to provide voice-driven interactivity in your Unity game.

Watch an example of Watson speech recognition and language classification in this Unity demo project.

For developers interested in the power of AI-driven visual recognition, Watson’s Vision API provides the ability for you to integrate real-time visual recognition within your Unity projects. Take a look at how a team of developers took advantage of the IBM Watson Unity SDK during an IBM-sponsored hackathon to create Watson and Waffles, a VR adventure game that requires the player to sketch game objects using the Vive controller. Using the Vision API, Watson identifies user drawings and generates corresponding 3D objects for the player to use.

Watson and Waffles, a VR adventure game created during an IBM sponsored Hackathon. Using the Vision API, IBM Watson identifies user drawings and generates corresponding 3D objects for the player to use. 

The SDK is simple to set up and can open up your project to new levels of interactivity. Imagine a game with non-player characters powered with visual recognition technology that recognize in-game objects or even a virtual reality experience with interactions driven completely with voice commands.

Receiving access to the IBM Watson Unity SDK is easy – simply head over to the Asset Store and download the SDK.  For more details about the Watson capabilities available within the IBM Watson Unity SDK that you can use to get started, take a look at the Watson products and services page.

You also can familiarize yourself with this short video series, which provides an overview of all of the core features of the IBM Watson Unity SDK.

Visit the IBM Watson page on the Unity Asset Store and download all available assets and resources!

If you are attending Unite Conferences, we will be at Unite Japan, Unite Berlin, and Unite Los Angeles. Come by our booths to see demos and ask any questions.

We’ve also rounded up some key resources to help you get started with the IBM Watson Unity SDK:

Join The Discussion

Your email address will not be published. Required fields are marked *