ClaudeCodeMod

All shelves / MCP servers

Unreal Gen AI

prajwalshettydev/unrealgenaisupport · 587 stars · C++ · MIT

MCP server Unreal Engine plugin for LLM/GenAI models & MCP UE5 server. OpenAI GPT-5, Deepseek R1, Claude Opus/Sonnet, Gemini 3, Grok 4, Alibaba Qwen, Kimi, ElevenLabs TTS, Inworld, OpenRouter, Groq, GLM, Ollama, Local, Meshy, Tripo, Hunyuan3D, Rodin, fal, Dashscope, Seedream.

Install

The repo has no one-line install. Follow its README.

Open the repo

Files

README.md

Usage Examples:

#### MCP Example: Claude spawning scene objects and controlling their transformations and materials, generating blueprints, functions, variables, adding components, running python scripts etc.

#### API Example: A project called become human, where NPCs are OpenAI agentic instances. Built using this plugin.

Unreal Engine Generative AI Support Plugin:

Every month, hundreds of new AI models are released by various organizations, making it hard to keep up with the latest advancements.

The "Unreal Engine Generative AI Support Plugin" allows you to focus on game development without worrying about the LLM/GenAI integration layer.

Current Progress:

This plugin will continue to get updates with the latest features and models. Contributions are welcome. For production-ready alternatives with 200+ AI models, guaranteed stability, automated testing, and UE 5.1-5.7+ support, check out the pro plugins below. This free plugin covers many use cases (including the examples above) and you can use it for free, forever.

Pro Plugins on Fab.com

Chat, Vision, Streaming, Realtime, Image Gen, TTS, Structured Output, Tool Use &utm_medium=repo-free&utm_campaign=genai-china-plugin">

Worldwide support, Chat, Vision, Image Gen, TTS, Reasoning &utm_medium=repo-free&utm_campaign=gen3d-plugin">

Text-to-3D, Image-to-3D, Remesh, PBR Textures, Retexture, Auto-Rigging &utm_medium=repo-free&utm_campaign=genai-llama-plugin">

Local LLMs inside your Unreal Engine game - no API keys needed

Free Plugin (This Repo) - LLM/GenAI API Support:

  • OpenAI: Chat (gpt-4.1, gpt-4.1-mini, o4-mini, o3, o3-pro), Structured Outputs
  • Anthropic Claude: Chat (claude-4-latest, claude-3-7-sonnet, claude-3-5-sonnet, claude-3-5-haiku)
  • XAI Grok: Chat (grok-3-latest, grok-3-mini-beta)
  • DeepSeek: Chat (deepseek-chat V3.1), Reasoning (deepseek-reasoning-r1)
  • Local AI: unreal-ollama (MIT) - gpt-oss, qwen3-vl and more

#### Gen AI Pro

  • OpenAI: gpt-5.4, gpt-5.4-pro, gpt-5.3-codex, gpt-5.2, gpt-5.1, gpt-5, gpt-5-mini, gpt-5-nano, gpt-4.1, o4-mini, o3, o3-pro | Responses API, Vision, Realtime (gpt-realtime), Image Gen (gpt-image-1.5, dall-e-3), TTS (gpt-4o-mini-tts, whisper-1), Streaming, Function Calling, Multimodal
  • Anthropic: claude-opus-4-6, claude-sonnet-4-6, claude-4.5-opus, claude-4.5-sonnet, claude-4.5-haiku | Extended Thinking, Vision, Tool Use
  • Google Gemini: gemini-3.1-pro, gemini-3.1-flash-lite, gemini-2.5-pro, gemini-2.5-flash | Imagen (imagen-4.0-generate, imagen-4.0-ultra), Realtime, TTS, Multimodal
  • XAI Grok: grok-4.1, grok-4, grok-4-eu, grok-code-fast-1, grok-3 | Vision, Streaming, Reasoning
  • ElevenLabs: TTS (eleven_v3, eleven_turbo_v2_5), Transcription (scribe_v2), Sound Effects (eleven_text_to_sound_v2)
  • Inworld AI: TTS (inworld-tts-1.5-max, inworld-tts-1.5-mini)
  • OpenAI Compatible Mode: Alibaba Qwen, Mistral, Groq, OpenRouter, Meta Llama, GLM-4, Ollama

#### Gen AI Pro China

  • Alibaba Qwen: qwen3.5-plus, qwen3.5-flash, qwen3-max, qwen3-coder-plus | Multimodal (qwen-omni-turbo, qwen-vl-max), Image Gen (qwen-image, wan2.2-t2i-plus), TTS (qwen3-tts-flash)
  • Moonshot/Kimi: kimi-k2.5, kimi-k2-thinking, kimi-k2-thinking-turbo | Multimodal (kimi-latest)
  • ByteDance: seed-2-0-mini, seed-1-8, skylark-pro-250415 | Vision (skylark-vision), Image Gen (seedream-4-0-250828)
  • ZhipuAI: glm-5, glm-4.7, glm-4.7-flash | Multimodal (glm-4.6v)
  • Baidu: ernie-5.0-8k, ernie-4.5-8k, ernie-x1-32k

#### GenAI Model Generator (3D)

  • Meshy AI: meshy-6 - Text-to-3D, Image-to-3D, Retexture, Auto-Rigging
  • Tripo AI: tripo-v2.5 - Text-to-3D, Image-to-3D
  • Hunyuan3D (Tencent): hunyuan3d-v3.1-pro Text-to-3D, hunyuan3d-v2.1 Image-to-3D
  • TripoSR: Image-to-3D (fast, <1s)
  • Rodin (Hyper3D): rodin-gen-2 - Text/Image-to-3D with PBR materials
  • Trellis 2 (Microsoft): Image-to-3D with PBR materials
  • Google Gemini: gemini-3.1-flash - PBR texture generation

Additional Features:

  • Plugin Example Project here
  • Version Control: Git Submodule Support, Perforce (in progress)
  • Lightweight: No External Dependencies, Exclude MCP from build
  • Testing across platforms and engine versions (available in pro plugins)

Unreal MCP (Model Control Protocol):

Other MCP options: Epic Games is working on an official Unreal MCP integration for UE 5.8+. There's also UnrealClaude (MIT) by Natfii - a standalone Unreal MCP implementation worth checking out. This plugin's MCP support targets UE 5.4-5.7+ and works alongside Claude Desktop, Claude Code, and Cursor. Note: MCP in this free plugin is not being actively developed - the features listed below reflect the current state.

  • Clients Support ✅
  • Claude Desktop App Support ✅
  • Claude Code CLI Support ✅
  • Cursor IDE Support ✅
  • OpenAI Operator API Support 🚧
  • Blueprints Auto Generation 🛠️
  • Creating new blueprint of types ✅
  • Adding new functions, function/blueprint variables ✅
  • Adding nodes and connections 🛠️ (buggy, issues open)
  • Advanced Blueprints Generation 🛠️
  • Level/Scene Control for LLMs 🛠️
  • Spawning Objects and Shapes ✅
  • Moving, rotating and scaling objects ✅
  • Changing materials and color ✅
  • Advanced scene features 🛠️
  • Generative AI:
  • Prompt to 3D model fetch and spawn 🛠️
  • Control:
  • Ability to run Python scripts ✅
  • Ability to run Console Commands ✅
  • UI:
  • Widgets generation 🛠️
  • UI Blueprint generation 🛠️
  • Project Files:
  • Create/Edit project files/folders ️✅
  • Delete existing project files ❌
  • Others:
  • Project Cleanup 🛠️

Table of Contents

  • Setting API Keys
  • For Editor
  • For Packaged Builds
  • Setting up MCP
  • Adding the plugin to your project
  • With Git
  • With Perforce
  • With Fab (Unreal Marketplace)
  • Fetching the Latest Plugin Changes
  • With Git
  • With Perforce
  • Usage
  • OpenAI
  • 1. Chat
  • 2. Structured Outputs
  • DeepSeek API
  • 1. Chat and Reasoning
  • Anthropic API
  • 1. Chat
  • XAI's Grok 3 API
  • 1. Chat

Facts

Kind
MCP server
Repo
prajwalshettydev/unrealgenaisupport
Group
Uncategorized
Stars
587
License
MIT
Language
C++
Last push
2026-04-28
Forks
105
Homepage
muddyterrain.com/docs
Topics
claude, code, dashscope, deepseek, game-development, gemini, generative-ai, google, gpt5, grok, llm, mcp, mcp-server, meta, openai, tts

More on this shelf

  1. 1Everythingmodelcontextprotocol/serversThis MCP server attempts to exercise all the features of the MCP protocol. It is not intended to be a useful server, but rather a test server for builders of MCP clients. It implements prompts, tools, resources, sampling, and more to showcase MCP capabilities.85.8k
  2. 2Fetchmodelcontextprotocol/serversA Model Context Protocol server that provides web content fetching capabilities. This server enables LLMs to retrieve and process content from web pages, converting HTML to markdown for easier consumption.85.8k
  3. 3Gitmodelcontextprotocol/serversA Model Context Protocol server for Git repository interaction and automation. This server provides tools to read, search, and manipulate Git repositories via Large Language Models.85.8k
  4. 4Memorymodelcontextprotocol/serversA basic implementation of persistent memory using a local knowledge graph. This lets Claude remember information about the user across chats.85.8k
  5. 5Sequential Thinkingmodelcontextprotocol/serversAn MCP server implementation that provides a tool for dynamic and reflective problem-solving through a structured thinking process.85.8k
  6. 6Timemodelcontextprotocol/serversA Model Context Protocol server that provides time and timezone conversion capabilities. This server enables LLMs to get current time information and perform timezone conversions using IANA timezone names, with automatic system timezone detection.85.8k