Revolutionizing Skyrim VR Conversations with AI Mod

Published On Sat May 13 2023
Revolutionizing Skyrim VR Conversations with AI Mod

Modder wires ChatGPT into Skyrim VR so NPCs can roleplay and...

A new mod for Skyrim VR has been developed that allows NPCs to roleplay using OpenAI’s large language model, ChatGPT. The modder Art From The Machine has wired up the NPCs with AI to create dynamic conversations in which the NPCs can generate responses to questions that are not listed on a menu in front of players. The NPCs can even remember experiences in the game and talk about them at length. With this mod, players can ask questions like store closing hours and receive straightforward answers. The NPCs can also describe, in detail, objects like the sword you're holding in the game.

While the early results of the mod are somewhat stilted, this technology offers a glimpse into the future of gaming. The NPCs' reactions can be generated on the fly, without needing to have specific dialogue written and recorded in advance. Even more intriguing is the possibility of AI-enabled NPCs remembering past events and conversations to bring that experience to future interactions. The modder has set up a basic memory system which uses ChatGPT to summarize the conversation on exit to help condense it down for future prompts. There are more sophisticated memory tools available, such as Langchain, which the modder hopes to implement in the future.

AI is not a new concept when it comes to video games, and Skyrim isn't the only game being modded with AI tools. Mount & Blade: Bannerlord also has a mod that enables its NPCs to use AI to answer questions typed by the players. By wiring AI into NPCs, modders are able to provide endless chatter, thanks to the advancements of ChatGPT. However, this mod doesn't solve the issue of whether all the dialogues will be interesting enough to want to listen to. Researchers recently populated a virtual town with AI agents, and while it was impressive that they threw parties and talked with each other, the conversations themselves were, in most cases, dull.

The ChatGPT-enabled mod isn't available for trial yet, as the modder wishes to add more features and do more bug testing before releasing it. Nonetheless, it provides a glimpse of what gaming could look like in the future.