Universal Offline LLM Plugin

Offline LLM Plugin is an Unreal Engine plugin that allows developers to prompt an LLM (LLAMA which is GPT like) offline and directly into UE blueprints. Prompts can be executed at runtime or at editor time.

Category:
Tags: , , , , , , , , , , ,

Description

Multiple models are supported (models repository : https://huggingface.co/models?search=gguf)

Demo here: https://youtu.be/XYvh9Gl5URE

Tuto here: https://youtu.be/PDKmFhN4OaY

This plugin allows you to integrate an AI in your game to generate texts and more (see https://arxiv.org/pdf/2302.05817v1.pdf).

The use cases are only limited by your imagination!

Obviously, it can easily be used for:

Documentation & model installation walkthrough : https://docs.isaratech.com/ue4-plugins/llama-plugin

A tutorial is available here to get you started with these https://docs.isaratech.com/ue4-plugins/llama-plugin/tutorial-how-to-make-an-interactive-discussion

And if you are used to language models like ChatGPT, you can imagine things way more fun to do with an AI in your game 🙂

As the plugin is callable in editor (eventually in the construction script), it’s even possible to imagine more usages:

Unlike most similar plugins or tools, this plugin doesn’t rely on an API: everything can run on your device and off-line (no internet connection required). The model files can be found for free on the internet, this way there is no pay-per-prompt policy: once installed and set-up, you can ask for an unlimited amount of prompts for free.

Warning: before purchasing the plugin, be aware of this:

Technical Details

Code Modules:

Number of Blueprints: 0

Number of C++ Classes: 7

Network Replicated: No

Supported Development Platforms: Win64

Supported Target Build Platforms: Win64

Documentation: https://docs.isaratech.com/ue4-plugins/llama-plugin

Supported Engine Versions

5.2 – 5.3