CHIM

Design Goals

• Never press "E" on an NPC ever again.
• Ability to have meaningful conversations with all AI NPCs.
• Seamless radiant conversations and interactions between AI NPC's.
• AI generated and controlled quests. With a large focus on conversation than combat.
• Complete as much of the game as possible through AI interaction.
• As comprehensive of a memory system as possible with current technology.
• Prevent roleplay hallucinations to keep AI NPC's in character.
• Easy plugin integration to allow modders to integrate their mod into our AI framework.

Current Features

• Ability to talk with all NPC's ingame, including horses!
• 1200+ character roleplay biographies.
• Oghma Infinium (RAG) to enhance AI roleplay by injecting lore topics dynamically into AI prompts. We have 1900+ lore topics.
• An AI narrator who will narrate and assist with your adventures.
• Dynamically generated biographies that update automatically during gameplay. This will change the NPC's goals and mood as you interact with them.
• Deep world awareness of the vast majority of ingame conversations and gameplay events.
• Detailed tracking of most actions and conversations you partake in your adventure.
• Full action commands, such as trading, attacking and traveling to locations.
• A mini 400MB LLM (MiniMe-T5) to help enhance memories and action commands.
• Instant generation of any voice using our CHIM XTTS service.
• And much more! Read our mod page for more details.

Technical Implementation

The architecture is a WSL2 Debian VM running an Apache2 webserver hosting PHP. We use PSQL as our database solution. We have integrated with many AI service providers such as OpenRouter, ChatGPT, Deepgram etc. The rest of the mod is made using the Creation Kit and SKSE.