Description
The AI Integration Toolkit streamlines the integration of OpenAI’s technologies, including ChatGPT, Dall-E, and Whisper, (and now Eleven Labs Text To Speech) into Unreal Engine. With accessible nodes exposed to Blueprints and clear examples, developers can efficiently incorporate AI to build interactive and captivating experiences in their projects.
This comprehensive toolkit enhances storytelling and organic interactions with NPCs and more using the ChatGPT API. The Dall-E API enables the generation of tailored images based on text prompts, allowing for customized content and distinct visuals. The Whisper API, complemented by ElevenLabs TTS, offers speech recognition and text-to-speech capabilities for more engaging and accessible gameplay.
Designed for developers of all skill levels, the AI Integration Toolkit features user-friendly Blueprint nodes that simplify the adoption of AI technologies in Unreal Engine projects. It also includes practical examples that demonstrate various applications, inspiring new ways to enrich gameplay experiences. By leveraging the power of generative AI technologies, developers can explore innovative dimensions of game design and create immersive environments for players.
Demonstration (V2 demo coming soon):
-Thanks!
Technical Details
Code Modules:
Number of Blueprints: 6
Number of C++ Classes: 12
Network Replicated: No
Supported Development Platforms: Windows
Supported Target Build Platforms: Windows
Documentation:
https://docs.google.com/document/d/1VFVGBZxefksB_4ZtuC4f4eC0m_MRojIR4pgH1lnrGJ4/edit?usp=sharing
Example Project:
Example content found in the plugin folder
Support:
Important/Additional Notes:
API Rate Limits: Be aware of the rate limits imposed by OpenAI’s API. Users with different subscription plans have varying rate limits.
Server Outages: OpenAI server outages can occur, leading to temporary unavailability of the API. Be prepared to handle such situations by implementing fallback mechanisms.
AIITK is not affiliated with OpenAI or ElevenLabs, please be sure to check pricing and availability from the respective sites.
Supported Engine Versions
4.27, 5.1 – 5.3
