Text To Lip Sync

Subtitles-based lip sync

Category:
Tags: ,

Description

It’s a real-time subtitles-based lip sync, i.e. it requires subtitles and audio to create animation. The plugin is using provided text subtitles to generate lips sync animation for characters in real-time. Audio envelope value from the synchronously activated audio component allows to detect silent intervals and to pause animation in this intervals and adjust future animation speed. Subtitles + Sound Asset = LipSync.

Demo video

Tutorial video

>>> Please try executable demo (link below) to weigh quality of an animation before you buy the plugin! <<<

Support (forums)

Technical Details

Code Modules:

Number of Blueprints: 0

Number of C++ Classes: 4 (1 actor component exposed to blueprints)

Network Replicated: No

Supported Development Platforms: Windows x64

Supported Target Build Platforms: Windows x64

Documentation: pdf + MetaHumans Setup

Example Project: [4.19] [4.26]

Executable Demo (try before you buy): zip

Additional Notes: Please contact me if you need it for educational purposes

Supported Engine Versions

4.19 – 4.27, 5.0 – 5.3