Speech To Life

Description

Speech To Life is a voice recognition plugin for Unreal Engine which gives you performant offline voice recognition for Windows and Android platforms including Quest 1 / 2. It includes a sentence fuzzy matching library to allow conversation selection-like gameplay and easily supports voice command control found in games where your voice causes actions/events to occur in the game world. This can be a very powerful mechanic in VR games where it adds an extra layer of ‘presence’.

Some examples of usage:

Considerations:

Speech To Life can support over 20 languages using the exceptional voice recognition supplied by Vosk.

This plugin contains a BONUS Fuzzy String Matching library exposed to blueprint for using a number of fuzzy string matching methods to match a voice recognition result sentence (or the words of) to a number of strings you are checking for. You can use this library for purposes other than voice recognition matching as well.

The plugin can be simply implemented into your own project and contains a fully working example found here.

NOTE: The example project is for Engine 4.27 and greater. Let me know on the Solar Storm Interactive Discord if you need a version for 4.26 and we can arrange something.

Engine 5.0 Example Project

Engine 5.0 Quest Specific Example Project

Engine 4.27 Example Project

Demos can be found here:

Documentation can be found here

Join the Solar Storm Interactive Discord here to get support!

This plugin would not be possible without the amazing work done on the Kaldi and Vosk projects. This plugin also contains the RapidFuzz C++ library for matching recognizer output sentence strings to strings pre-defined by the designer to be checked against.

Vosk : https://alphacephei.com/vosk/

RapidFuzz : https://github.com/maxbachmann/RapidFuzz