ChatGPT Brings Skyrim NPCs to Life in VR Mod
Virtual reality (VR) games depend on immersing the player into the role-playing world. Repetitive answers from non-player characters (NPCs) can kill the immersion quickly. To prevent such situations, a new AI mod for The Elder Scrolls V: Skyrim VR uses OpenAI's ChatGPT chatbot to provide more natural dialogue and interactions.
The developer, known on Reddit as "Art_from_the_Machine," has created a Python programming script to generate NPC responses using ChatGPT's GPT-3.5 language model. The AI mod uses the speech synthesis tool "xVASynth" to read out the responses to players. The developer is currently integrating the script into Skyrim VR's modding tools to create even more natural conversations with AI characters.
According to "Art_from_the_Machine," NPCs in the game are now aware of their location and the time of day. This feature helps ChatGPT react dynamically to the game world instead of waiting for the player to provide context. For example, shopkeepers won't trade with players after closing time. NPCs will also comment on player actions, such as looting a chest or picking a flower, during a conversation.
Previously, long "thinking pauses" of up to 15 seconds disrupted the flow of the conversation. However, in the sample video, NPCs bridge this gap quite naturally with a "Let me think" before answering. To address NPCs, the developer uses a microphone and voice recognition. Subsequently, the voice is replaced with a computer voice in the video above.
The mod community Flat2VR suggests using paid programming interfaces, such as Elevenlabs.io API voices, to make the implementation even more natural. Basic memories from previous conversations can also be accessed by NPCs. Each character gets an individually prepared prompt to help "slip into his role," almost like an actor.
Other games are using AI to converse with virtual characters. For example, the VR golf game, Golf+, features an AI caddie named Arthur. Using ChatGPT's language model, Arthur offers natural dialogue and creates workouts on the side.
The ChatGPT-based mod for Skyrim VR is still in development. No official release date has been announced yet.
