Skyrim Mod Uses ChatGPT and Other AI Tools to Give NPCs a Dynamic and Interactive Experience
A Skyrim modder, Art From The Machine, is currently working on a Skyrim mod that is set to enhance the way non-playable characters (NPCs) interact with the player. The mod uses ChatGPT and other artificial intelligence (AI) tools to give NPCs a memory of the player's adventure, unlimited dialogue options, and the ability to answer questions via voice commands.
The Skyrim mod combines ChatGPT, xVASynth, and Whisper to produce the dynamic experience. xVASynth allows NPCs to speak their responses with an AI version of their voice. Whereas Whisper allows the player to ask questions using their own voice via a microphone. Although the new NPC responses are not yet perfect, the Skyrim mod has shown promise of a world where NPCs can offer comments on almost everything the player does and even answer questions directly from the player that are not canned responses from a list of dialogue options.
As seen in the demonstration video, the player can engage in a conversation with Ulfberth War-Bear from Warmaiden's in Whiterun. The player can ask about the store's hours of operation and even how much time remains until the store closes based on the in-game clock. Ulfberth is also seen describing a sword the player picks up; any NPC can dynamically explain various items in the world to the player as part of a conversation, instead of having that information solely in text form on a menu.
The modder is currently working on a basic memory system using ChatGPT to promote NPCs remembering the player's conversations. Art From The Machine stated, "I have a basic memory system set up where I ask ChatGPT to summarize the conversation on exit to help condense it down for future prompts."
While AI-driven text is impressive, one of the most significant ongoing questions in AI development is whether AI-driven text can ever match human-generated content. It is one thing to have endless content in a game, but does it matter if it doesn't feel real or layered or crafted with the context of our own past experiences and identity? Only time will tell if Skyrim modder Art From The Machine's vision can come to fruition.
