Other user's assetsAll the assets in this file belong to the author, or are from free-to-use modder's resources
Upload permissionYou can upload this file to other sites but you must credit me as the creator of the file
Modification permissionYou are allowed to modify my files and release bug fixes or improve on the features without permission from or credit to me
Conversion permissionYou can convert this file to work with other games as long as you credit me as the creator of the file
Asset use permissionYou are allowed to use the assets in this file without permission or crediting me
Asset use permission in mods/files that are being soldYou are not allowed to use assets from this file in any mods/files that are being sold, for money, on Steam Workshop or other platforms
Asset use permission in mods/files that earn donation pointsYou are not allowed to earn Donation Points for your mods if they use my assets
Author notes
This author has not provided any additional notes regarding file permissions
File credits
This author has not credited anyone else in this file
Donation Points system
Please log in to find out whether this mod is receiving Donation Points
Rechat Actions - Allows NPCs to perform functions without player input. Will cause chaos....
Deep Translate - NPC translation settings for audio/subtitles and Player TTS override support. @Deekana
TXT2VEC - Readded from the Herika days but now much faster. Improves a lot of the RAG capabilities of Oghma, memories, etc.
New Actions:
Follow - It actually works now! Can be used to get NPCs to follow you or each other.
Come Closer - Use it to get an NPC to approach you. Useful when seated.
Trade Items - WIP. Fake trade of items between NPCs for now.
Give Gold - WIP. Fake give gold between and too NPCs to enhance RP scenes.
Fight/Brawl - Non-lethal combat between 2 NPC's with weapons.
Go to Sleep - Followers only, will use nearest bed. Make sure to get your 8 hours a day!
Use Soul Gaze - Triggers Soulgaze ITT for the NPC.
Return Back Home - WIP. Will be used to despawn newly spawned NPCs coming very soon.
Everything Else:
"Halt" safeword changed to "Wake Up"
Zonos TTS added with vast.ai support @.dekana
Tapping the voicekey will stop all AI Speech
Improved LOS Targeting logic for conversations.
Plugin Page Rework
Improved Oghma vectors
Improved Functions logic
Improved Attack actions targeting
Improved TravelTo targeting
Send all locations to server util to improve Travelto accuracy
InspectNPC improvements to dead bodies
Improved animation stability
Cyrillic lip syncing @dekana
TTSFUNCTION_PLAYER_LANGUAGE as an override TTS language for Player TTS when talking to an NPC who is speaking a different TTS language @dekana
Cowards will now actually attack
Enforce Actions configuration option
Remove Astriks configuration option
Improved action cooldowns
Massive stability improvements to plugin and handling large amounts of AI NPCs
Deprecated Google TTS, ConvAI TTS, LLama/LLava (Use Koboldcpp openai API for ITT)
Fix the OpenRouter xrefer link
OpenAI fix for CoT output @id1001
Some French language translations @Dalek Caan
Fixed "/" bug for XTTS/Zonos URL
Version 1.2.1
Hotfix to fix CHIM.exe port proxy timeout
Version 1.2.0
CHIM.exe is now packaged with AIAgent for easier installation and updates. Recommend you make it a desktop shortcut.
The CHIM.exe now acts as a port proxy between CHIM and Skyrim. This means that you never have to generate the AIAgent.ini.
The Distro now will automatically update all the component repositories now. If there are any future requirement issues, they will be a fast fix.
A whole bloody Wiki, with some sneak peaks of next updates features, at: https://dwemerdynamics.hostwiki.io/
Improved CHIM.exe UI
CHIM.exe has a Generate Diagnostic File button now that helps us troubleshoot issues.
Version 1.1.1.3
Fixed several issues causing NPC's to sometimes get stuck in disabled state (No "E" to interact) @min
Several CTD fixes @min
Reduced probability of "Thanks for Watching!" by tweaking recording window @min
General stability improvements @min
Fixed issue causing NPC's to spam "..." @min
Fixed crash with some types of modded followers @min
Fixed crash on game load that was occurring sometimes. @min
Fixes the Set Default key in the MCM @daikicihi
When changing a hotkey in the MCM if you hit escape it will clear the key @daikicihi
Prevents chim hotkeys from being triggered while typing in the console, or in other text inputs, or some other modded menus (quickloot, racemenu, etc) @daikicihi
Version 1.1.1.1
Hotfix for bored event spam, make sure to also update the CHIM server.
Version 1.1.1
Run Update Server & download the new AIAgent mod file.
You do not need the new DwemerDistro file if you already have it installed.
The new Distro just includes Japanese lipsync patch & updated CHIM.exe.
WebUI Overhaul
Major stability improvements to the CHIM plugin @min
Audio improvements and fixes to ingame AI speech @min
Improved stability with the Nolvus modlist @min
Fixes to freezes and CTD @min
Added Profile Locking
CHIM.exe can now switch between branches.
Patch download for Skyrim LocalWhisper STT model @meek
Changed default OpenRouter LLM to LLama3.3
Oghma now works with rechat and can handle multiple keywords
Japanese Lip Sync @Daikicihi
Improve behaviour with reasoning models with Open Router @id1001
Default database fix @daikichi
Oghma and NPC Management now have a search bar
More Dynamic Prompts @min
Factory Reset Oghma database button
Tamrielic Timestamps added to most display tables @id1001
Edit to openrouterjson prompting @fableforge
Timesync fixes @min @daikichi
Version 1.1.0
All you have to do is run Update Server in the DwemerDistro! There is no change to the AIAgent.esp.
If you are updating and have custom Oghma 1.0 entries, back them up before running the server update.
Oghma Knowledge Classes will only get applied to newly generated NPC profiles.
**Changelog:**
Oghma Infinium 2.0 - The AI knows what it doesn't know by knowing what it knows.
Added ALIVE_MESSAGE toggle option.
Added options to toggle specific roleplaying comments.
Improved configuration wizard UI.
Delete events in batches button added.
Hopefully (for real) fixed Database updates.
Allow xVASynth to use voices from other games.
Improved UI for NPC Management and Oghma Management.
Herika blackface should be fixed.
Toggle Dynamic AI Objective @daikicihi
Time Awareness for NPCs @galanx & @daikcihi
Memory summaries can be edited.
Better default Dynamic Prompt @wrilath
Fixed Dynamic Prompt to use summary connector MAX_TOKENS_MEMORY settings.
Fix halt with ReChat @daikichi
Fixed xVASynth player TTS voice.
Fixes memory summary, diary, and dynamic profile updates when using koboldcpp @daikichi
Version 1.0.21
Dynamic Profiles 2.0 - split biographies into Static and Dynamic
Real Names Extended support (manual has more info, credit to @min for the script)
CHIM XTTS voice generation option to use voiceid based on NPC voicetype (is new default)
Made NARRATOR_WELCOME less annoying by adding a 10 min cool-down
Made QUEST_COMMENT better by being able to adjust chance to trigger
Reworked RECHAT_P and BORED_EVENT logic
MCM option for fixing 3D spatial sound bug
Animation improvements
Chat testing UI improvements
Diary interface improved
Support for Freya Alvorsdottir from @hunding
LLM Tierlist added @unkwn prson
Small change to sound folder
Version 1.0.20
Download the latest AIAgent.esp and click Update Server in the CHIM launcher.
Changelog:
Spanish translation (read manual for more info)
Doolittle upgrades for animal interactions
Custom Prompt page improvements
Hopefully fixed automatic database updates
Chrome STT delay options added
Newest filter added for profile selection
Better log menus
JP Support @daikichi
ES LocalWhisper support (download the patch in Optional Files)
Version 1.0.19
Just make sure you have downloaded the latest AIAgent.esp and run Update Server.bat
Changelog:
Added Oghma Infinium (Lore injection in AI NPCs, enable and run Minime-t5)
AI NPCs should trigger bored events more often now
Add VoiceID override to NPC biography tables
Websocket for using web AI chatbot with CHIM @Shadow LAG
Save button moved to be more visible
Added sliders to the Configuration Wizard
AI Adventure Log to view history of your entire playthrough
Made troubleshooting tests better
Lot of small fixes
Version 1.0.18
You just need to install the new AIAgent and run update.bat.
Free STT hack added
Custom prompt editor
Improved plugins manager
Windows 11 internal traffic errors fixed
Nirnroot tinnitus sound fixed
AiAgent Spells changed to CHIM names now
Many other minor bugs
Version 1.0.14
Small bug and CTD fixes.
Version 1.0.12
All you need to do is download the new AIAgent Skyrim mod and run update.bat! Safe to update midgame.
Changelog:
Player TTS Support Added
xVASnyth Support Added
AIAgent bug fixes (should crash less with OAR thanks @Min!)
Reworked XTTS Management Menu
Added Player Biographies (Information about the player presented to the LLM)
All you need to do is download the new AIAgent Skyrim mod and run update.bat!
Changelog:
The mod is much less crashy now! (Thanks to @Min for helping find crashes!)
MCM option to change timeout time
MCM option to disable animations (should stop crashes that happen with OAR)
Fixes to better support MinAI
Minor fixes when NPCs are deactivated
Reworked how specific voices work with XTTS
Version 1.0
No newgame required, requires new distro download and AIAgent mod. Can backup and import old distro with Database Backup. Installation now much easier! MeloTTS added to Distro Redone all NPC character biographies (we are doing more with this later....) Small UI improvements to WebServer Fixed ' bug (Khajit is happy now) Fixed move/telekinesis CTD bug Fixed bugs for MinAI support (check it out!) Other minor bug fixes
Version 0.9.6
Better NPC voice generation with XTTS
Added support for new function WaitHere
Added support for spells. Is an optional Download
Improved DwemerDistro 3 installation setup
Database backup and recovery
Configuration wizard improvements
MeloTTS support
Official follower support for Neiva Deep Water: https://www.nexusmods.com/skyrimspecialedition/mods/112162
CHIM is a powerful AI framework for Skyrim. The goal of this mod is to allow you to have meaningful interactions with AI NPCs. We plan to integrate AI systems within as much of Skyrim as possible.
It is also possible to integrate your own mods within our framework. CHIM Wiki
👨👩🐴ANY NPC CAN BE AN AI
All NPCs are automatically AI around the player. You will be able to interact with them either with your voice or a chat-box. It will work with ANY NPC: vanilla, modded and even horses!
Most vanilla NPC's already have written character biographies to guide their roleplay. You can easily mass upload your own character biographies using a simple .csv file! Each NPC can be individually customized with different personalities, voices and AI models to fine tune them to your liking.
We also provide inbuilt support for Real Names Extended. This dramatically improves the role-play of all generic NPCs!
We are also happy to support mod authors who want their NPC's to be officially supported. More Info Here
🎥DIRECTOR MODE
Director Mode is a powerful tool that allows you to command AI NPCs to do your bidding.
When you go into director mode all player input will be sent to the Director. They will take your request and do their best to make it a reality with the NPCs nearby.
Examples:
Start a bar fight.
I want the City Guard to attack Heimskr for being annoying.
Arngeir should travel to Solitude to pickup some sweetrolls.
I want my followers to stop complaining about all the loot I am taking for myself.
Jarl Balgruuf should tell a really bad joke.
🎭🧠DYNAMIC PERSONALITIES AND MEMORIES
Dynamic Personalities: Each AI NPC has a static and dynamic personality biography. Their dynamic biography will change automatically depending on the previous interactions they had with the player and the world around them.
Dynamic Personality Example: * Relation with RANGROO: Jenassa respects RANGROO's growing strength and tactical insight, viewing him as a wise partner. Their bond deepens through shared battles, with her encouraging him to embrace his potential while showcasing her own prowess. She playfully challenges him and expresses pride in his progress, urging him for direction while maintaining her competitive spirit. Jenassa appreciates his leadership and enjoys their camaraderie, often engaging in banter while navigating challenges together, reflecting a balance of respect and excitement in their adventures.
* Likes: Combat, gold, strength, tactical acumen, excitement; enjoys the thrill of facing foes, especially bandits. Recently, she has shown interest in home decoration, indicating a potential appreciation for the fruits of their labor beyond combat. She relishes the idea of adventure and is eager for the next challenge.
* Fears: Undead foes, confined spaces, being alone in danger; particularly averse to the undead as significant threats. She fears being caught off guard or unprepared in dangerous situations, which can undermine her confidence and sense of security.
* Dislikes: Daydreaming, distractions from combat, bandits; prefers focusing on immediate threats and despises frivolous thoughts during missions. She expresses disdain for anyone who underestimates their enemies or detracts from their goals. Long-Term Memories: Each AI NPC will have their conversations and interactions they have participated in saved to a database. This allows them to recall specific events and conversations hours later and will affect how they interact with the player.
My companion, Herika, made a comment saying "Another one bites the dust, eh Rangy? (My name is RANGROO) That mudcrab met a shell-shocking end!"
I tell her "Is that my new nickname? Rangy?".
She says "Well, I could call you Swamp Breath if your prefer" (I am an Farm-Tool Argonian)
I relent and move on with the adventure.
For the next few hours of gameplay she would keep referring to me as "Rangy" instead of "RANGROO".
This was due to the long-term memory system implanting memories of her calling me "Rangy" instead of "RANGROO", so that was my new name ¯\_(ツ)_/¯
🌎INDEPTH WORLD AWARENESS
We feed A LOT of information about what is happening in-game directly to the AI to make sure it will respond as accurately as possible.
What the AI Tracks:
Combat Encounters
Dialogue (traditional and AI spoken)
Time/Date
Weather
Location (including modded location)
Quests (including modded quests)
Player Statistics
Player Biography (you can easily customize it)
Items Acquired
Equipment
Memories
Diary Entries
Books
Who was present during conversations (you can keep secrets from AI NPC's!)
Tamrielic lore topics (Oghma Infinium Feature)
📙🐙OGHMA INFINIUM (RAG) “The AI knows what it does not know by knowing what it knows.”
The Oghma Infinium will inject Tamrielic lore information (RAGs) into the AI NPC's prompt whenever they talk. We have a database of over 1900+ topics covering everything in Skyrim. However AI NPC's will only be presented with information that is appropriate to their character.
Here is how this makes for meaningful interactions:
Blacksmiths will know how to craft specific weapons.
Fishermen can tell you how to catch specific fish.
Scholarly book nerds can talk about the meaning behind “The Wolf Queen”.
Someone from Riften can tell you where Northwind Summit is, someone from Solitude will have no idea where it is.
Alchemists can tell you what an ingredient’s magical properties are.
A Redguard can go into detail about their specific Gods.
Each topic has an Advanced and Basic article. Advanced articles are what an expert would know about a subject. Basic articles for the most part are what an average lay person of Skyrim would know about a subject.
Logic for searching articles:
NPC will search for oghma article based on most relevant keyword.
Check knowledge_class to see if they access to the advanced article.
Check knowledge_class_basic to see if they access to the basic article.
If all above fails, send "You do not know about X" to the prompt.You can also easily add your own lore topics into the database to match your specific canon to your play-through of Skyrim.
The game design for this system is that correct world information will be injected into AI NPCs during regular conversation. We don’t expect or want you to always have to ask “What do you know about X?”. Instead through regular play and dialogue, you should notice that AI NPC’s act a little bit smarter. They should make more on-the-nose references to relevant topics that come up naturally through play.
You can easily edit and add your own topics to match your specific Skyrim canon or modded playthrough.
👉ACTION COMMANDS
Through natural conversation the AI will trigger in-game actions, whether directly initiated by the player or on their own accord.
Note: Actions are more likely to trigger through natural conversation with smarter LLM's. Dumber LLM's will have a harder time triggering actions unless you specifically say the command exactly. Also AI NPCs will only trigger actions if they want to... Command List:
Inspect NPC
Inspect Surroundings
Move To (Short distance travel to nearby entities/enterable buildings in the same cell, e.g. “Move to the Bannered Mare")
Travel To (Long distance travel to fast travel locations, e.g. “Travel to Solitude”)
Attack - Fight to Kill
Fight/Brawl - Fight to knock out
Trade Items - WIP does not trade actual items. RP only.
Give Gold - WIP does not give actual gold. RP only.
Go to Sleep - Use nearest bed.
Use Soul Gaze
Come Closer
Open Inventory (Followers = Inventory Menu, Other NPCs = Barter Menu)
Check Inventory
Sheathe Weapon
Follow
Take A Seat
Read Quest Journal (Allow the AI to see your current quests)
Increase Walk Speed
Decrease Walk Speed
Set Current Task
Wait Here
Stop Walking
Wake Up (Will hard stop any AI actions)
📚AI NARRATOR There is an AI narrator who will always be present. Though you can turn them off if you want.
They will narrate your adventures, recap what has previously happened and offer help with your current tasks. You can also skip through dialogue and have the Narrator summarize it!
Like with all other AI NPC's, you can fully customize their personality and voice.
If you are alone with no AI NPC's every time you speak the narrator will respond. Otherwise, start any sentence with "Hey Narrator".
📃EVERYTHING ELSE
Twitch Chat plugin that allows viewers to control AI NPCs.
Soulgaze allows the AI to visually see and describe what is shown in-game.
Summarize any book in game and have it read aloud like an audio log.
Player AI TTS voice which allows your character to actually speak!
Each AI NPC will only be aware of events which they have witnessed.
AI NPC's will play animations based on their mood.
Diary entries can be written by the AI NPC's, describing the current adventure from their perspective.
Very deep customization, every setting can be fine tuned and tweaked to your liking for each NPC.
Our own custom trained tiny LLM model (Minime-T5) which improves the accuracy for actions and memory functions.
Wide range of support for offline and online AI services.
VR Support? Yes! With some notes:
XTTS voice generation may be a bit buggy
Make sure to download the VR versions of the mod requirements
Why are there 2 files to download? DwemerDistro3is a WSL2 virtual machine that can run on most windows computers. It acts as the "AI Brain" for the entire mod. It runs in the background while you play Skyrim.
AIAgent is installed normally like any other Skyrim Mod.
Compatibility? This mod is compatible with 99% of other mods. Most of the AI scripting is noninvasive. Does not require new saves, can be uninstalled whenever.
Compatibility issues: OAR - Is inconsistent in crashing when using CHIM animations. We have CHIM AI Animations disabled by default. We recommend you turn it on and test it yourself as it adds a lot to the immersion! Frame Generation - Incompatible with our SoulGaze (ITT) feature. NPC Renamer Mods - Can cause weird bugs with certain character profiles. We recommend to only use Real Names Extended. LoreRim - Bug with generating character profiles due to name changes. We have a hotfix in our #csv-files channel in our discord. Mods that look for crosshair events - Can cause bugs when try to talk to AI NPC's under your crosshair.