File information

Last updated

Original upload

Created by

Dwemer Dynamics

Uploaded by

rang97

Virus scan

Some files not scanned

About this mod

Fundamentally, you will have meaningful interactions with something that is not human.

Requirements
Permissions and credits
Translations
Changelogs









CHIM is a powerful AI framework for Skyrim.
The goal of this mod is to allow you to have meaningful interactions with AI NPCs.
We plan to integrate AI systems within as much of Skyrim as possible.

It is also possible to integrate your own mods within our framework.
CHIM Wiki






👨👩🐴ANY NPC CAN BE AN AI

All NPCs are automatically AI around the player.
You will be able to interact with them either with your voice or a chat-box.
It will work with ANY NPC: vanilla, modded and even horses!

Most vanilla NPC's already have written character biographies to guide their roleplay.
You can easily mass upload your own character biographies using a simple .csv file!
Each NPC can be individually customized with different personalities, voices and AI models to fine tune them to your liking.

We also provide inbuilt support for Real Names Extended. This dramatically improves the role-play of all generic NPCs!

We are also happy to support mod authors who want their NPC's to be officially supported.
More Info Here

    
🎥DIRECTOR MODE

Director Mode is a powerful tool that allows you to command AI NPCs to do your bidding.

When you go into director mode all player input will be sent to the Director. They will take your request and do their best to make it a reality with the NPCs nearby.

Examples:
  • Start a bar fight.
  • I want the City Guard to attack Heimskr for being annoying.
  • Arngeir should travel to Solitude to pickup some sweetrolls. 
  • I want my followers to stop complaining about all the loot I am taking for myself.
  • Jarl Balgruuf should tell a really bad joke.


🎭🧠DYNAMIC PERSONALITIES AND MEMORIES

Dynamic Personalities: Each AI NPC has a static and dynamic personality biography. Their dynamic biography will change automatically depending on the previous interactions they had with the player and the world around them.

Dynamic Personality Example:
* Relation with RANGROO: Jenassa respects RANGROO's growing strength and tactical insight, viewing him as a wise partner. Their bond deepens through shared battles, with her encouraging him to embrace his potential while showcasing her own prowess. She playfully challenges him and expresses pride in his progress, urging him for direction while maintaining her competitive spirit. Jenassa appreciates his leadership and enjoys their camaraderie, often engaging in banter while navigating challenges together, reflecting a balance of respect and excitement in their adventures.

* Likes: Combat, gold, strength, tactical acumen, excitement; enjoys the thrill of facing foes, especially bandits. Recently, she has shown interest in home decoration, indicating a potential appreciation for the fruits of their labor beyond combat. She relishes the idea of adventure and is eager for the next challenge.

* Fears: Undead foes, confined spaces, being alone in danger; particularly averse to the undead as significant threats. She fears being caught off guard or unprepared in dangerous situations, which can undermine her confidence and sense of security.

* Dislikes: Daydreaming, distractions from combat, bandits; prefers focusing on immediate threats and despises frivolous thoughts during missions. She expresses disdain for anyone who underestimates their enemies or detracts from their goals.

Long-Term Memories
: Each AI NPC will have their conversations and interactions they have participated in saved to a database. This allows them to recall specific events and conversations hours later and will affect how they interact with the player.

Example:
  • I used a crossbow to kill a mudcrab.
  • My companion, Herika, made a comment saying "Another one bites the dust, eh Rangy? (My name is RANGROO) That mudcrab met a shell-shocking end!"
  • I tell her "Is that my new nickname? Rangy?".
  • She says "Well, I could call you Swamp Breath if your prefer" (I am an Farm-Tool Argonian) 
  • I relent and move on with the adventure.
  • For the next few hours of gameplay she would keep referring to me as "Rangy" instead of "RANGROO".
  • This was due to the long-term memory system implanting memories of her calling me "Rangy" instead of "RANGROO", so that was my new name ¯\_(ツ)_/¯


🌎INDEPTH WORLD AWARENESS

We feed A LOT of information about what is happening in-game directly to the AI to make sure it will respond as accurately as possible.

What the AI Tracks:
  • Combat Encounters
  • Dialogue (traditional and AI spoken)
  • Time/Date
  • Weather
  • Location (including modded location)
  • Quests (including modded quests)
  • Player Statistics
  • Player Biography (you can easily customize it)
  • Items Acquired
  • Equipment
  • Memories
  • Diary Entries
  • Books
  • Who was present during conversations (you can keep secrets from AI NPC's!)
  • Tamrielic lore topics (Oghma Infinium Feature)


📙🐙OGHMA INFINIUM (RAG)
“The AI knows what it does not know by knowing what it knows.”

The Oghma Infinium will inject Tamrielic lore information (RAGs) into the AI NPC's prompt whenever they talk. We have a database of over 1900+ topics covering everything in Skyrim. However AI NPC's will only be presented with information that is appropriate to their character.

Here is how this makes for meaningful interactions:
  • Blacksmiths will know how to craft specific weapons.
  • Fishermen can tell you how to catch specific fish.
  • Scholarly book nerds can talk about the meaning behind “The Wolf Queen”.
  • Someone from Riften can tell you where Northwind Summit is, someone from Solitude will have no idea where it is.
  • Alchemists can tell you what an ingredient’s magical properties are.
  • A Redguard can go into detail about their specific Gods.
Each topic has an Advanced and Basic article.
Advanced articles are what an expert would know about a subject.
Basic articles for the most part are what an average lay person of Skyrim would know about a subject.

Logic for searching articles:
  •  NPC will search for oghma article based on most relevant keyword.
  • Check knowledge_class to see if they access to the advanced article.
  • Check knowledge_class_basic to see if they access to the basic article.
  • If all above fails, send "You do not know about X" to the prompt.You can also easily add your own lore topics into the database to match your specific canon to your play-through of Skyrim.

The game design for this system is that correct world information will be injected into AI NPCs during regular conversation. We don’t expect or want you to always have to ask “What do you know about X?”. Instead through regular play and dialogue, you should notice that AI NPC’s act a little bit smarter. They should make more on-the-nose references to relevant topics that come up naturally through play.

You can easily edit and add your own topics to match your specific Skyrim canon or modded playthrough.

👉ACTION COMMANDS

Through natural conversation the AI will trigger in-game actions, whether directly initiated by the player or on their own accord.

Note: Actions are more likely to trigger through natural conversation with smarter LLM's. Dumber LLM's will have a harder time triggering actions unless you specifically say the command exactly. Also AI NPCs will only trigger actions if they want to...

Command List:

  • Inspect NPC
  • Inspect Surroundings
  • Move To (Short distance travel to nearby entities/enterable buildings in the same cell, e.g. “Move to the Bannered Mare")
  • Travel To (Long distance travel to fast travel locations, e.g. “Travel to Solitude”)
  • Attack - Fight to Kill
  • Fight/Brawl - Fight to knock out
  • Trade Items - WIP does not trade actual items. RP only.
  • Give Gold - WIP does not give actual gold. RP only.
  • Go to Sleep - Use nearest bed.
  • Use Soul Gaze
  • Come Closer
  • Open Inventory (Followers = Inventory Menu, Other NPCs = Barter Menu)
  • Check Inventory
  • Sheathe Weapon
  • Follow 
  • Take A Seat
  • Read Quest Journal (Allow the AI to see your current quests)
  • Increase Walk Speed
  • Decrease Walk Speed
  • Set Current Task
  • Wait Here
  • Stop Walking
  • Wake Up (Will hard stop any AI actions)


📚AI NARRATOR
There is an AI narrator who will always be present.
Though you can turn them off if you want.

They will narrate your adventures, recap what has previously happened and offer help with your current tasks.
You can also skip through dialogue and have the Narrator summarize it!

Like with all other AI NPC's, you can fully customize their personality and voice.

If you are alone with no AI NPC's every time you speak the narrator will respond.
Otherwise, start any sentence with "Hey Narrator".



📃EVERYTHING ELSE

  • Twitch Chat plugin that allows viewers to control AI NPCs.
  • Soulgaze allows the AI to visually see and describe what is shown in-game.
  • Summarize any book in game and have it read aloud like an audio log.
  • Player AI TTS voice which allows your character to actually speak!
  • Each AI NPC will only be aware of events which they have witnessed.
  • AI NPC's will play animations based on their mood.
  • Diary entries can be written by the AI NPC's, describing the current adventure from their perspective
  • Free speech-to-text service using Chrome.
  • Very deep customization, every setting can be fine tuned and tweaked to your liking for each NPC.
  • Our own custom trained tiny LLM model (Minime-T5) which improves the accuracy for actions and memory functions.
  • Wide range of support for offline and online AI services.




VR Support?
Yes! With some notes:
  • XTTS voice generation may be a bit buggy
  • Make sure to download the VR versions of the mod requirements

Why are there 2 files to download?
DwemerDistro3 is a WSL2 virtual machine that can run on most windows computers.
It acts as the "AI Brain" for the entire mod. It runs in the background while you play Skyrim.

AIAgent
is installed normally like any other Skyrim Mod.



Translations?
Yes!
Spanish/Español

Japanese/日本語 (にほんご


What AI services should I use?
Read our introduction guide here!



Compatibility?
This mod is compatible with 99% of other mods. Most of the AI scripting is noninvasive.
Does not require new saves, can be uninstalled whenever.

Compatibility issues:
OAR - Is inconsistent in crashing when using CHIM animations. We have CHIM AI Animations disabled by default. We recommend you turn it on and test it yourself as it adds a lot to the immersion!
Frame Generation - Incompatible with our SoulGaze (ITT) feature. 
NPC Renamer Mods - Can cause weird bugs with certain character profiles. We recommend to only use Real Names Extended.
LoreRim - Bug with generating character profiles due to name changes. We have a hotfix in our #csv-files channel in our discord.
Mods that look for crosshair events - Can cause bugs when try to talk to AI NPC's under your crosshair.

We highly recommend you use:
Nether's Follower Framework
To Your Face 
Real Names Extended
Subtitles & Subtitles VR
CrosshairRefEvents (Only available from LoversLabs)



What in Oblivion does CHIM even mean?
Read this: https://en.uesp.net/wiki/Lore:CHIM


How does this even work?
This is an older video but its still covers the fundamentals:




EASY TO FOLLOW INSTALLATION GUIDE HERE

Installation Video:
(It's slightly out of date, we recommend following the installation guide above.)


CHIM Wiki

🚨If you have issues with installation and need help, then join our Discord and ask for help in the "i-have-a-problem" channel!