SKYRIM
Skyrim Voice Command Engine by Swat and Maverick
Skyrim » Utilities
Added: 21/02/2017 - 01:04AM
Updated: 27/04/2017 - 03:33AM

4 Endorsements

Alpha.19b Latest version

62 Unique D/Ls

90 Total D/Ls

5,340 Total Views

Uploaded by irswat

Description

Last updated at 3:33, 27 Apr 2017 Uploaded at 1:04, 21 Feb 2017




SVCE ALLOWS YOU TO USE THE MICROPHONE IN SKYRIM TO SHOUT THUUMS, EQUIP AND UNEQUIP WEAPONS, ARMOR, AND ARROWS, USE POTIONS AND POISONS, EQUIP AND CAST SPELLS AND MORE! EVER WANTED TO YELL "FUS ROH DAH"? NOW YOU CAN!

NOTE: THIS IS A PUBLIC ALPHA. PLEASE READ THIS IN ITS ENTIRETY! LEAVE FEEDBACK IN THE COMMENTS. FEEL FREE TO MAKE BUG REPORTS. I'LL GET TO THEM AS TIME PERMITS. DUE TO THE LACK OF USER FEEDBACK, AND LACK OF INTEREST I AM CEASED DEVELOPMENT INDEFINITELY. IF PEOPLE BEGIN TO SHOW INTEREST IN VOICE COMMANDS FOR SKYRIM, AND BEGIN GIVING FEEDBACK, THEN I WOULD BE DELIGHTED TO PICK UP DEVELOPMENT AGAIN.

UPDATE: ALPHA .18 IS RELEASED. IT FEATURES A REWORKED DATA STRUCTURE PREPARING FOR MOD COMPATIBILITY, AS WELL AS SOME OTHER SIGNIFICANT CHANGES IN THE ENGINE. IF YOU HAVE PREVIOUSLY INSTALLED .11-.13 SIMPLY DELETE VR.EXE AND RECOGNITION_OUT.TXT FROM SKYRIM BASE DIRECTORY AND EXTRACT THIS FILE. Overwrite all files when asked. VR.EXE IS NOW LOCATED IN SKYRIM\SVCE\ (I make a shortcut to desktop for ease of use). After Launching VR.exe make sure to click start reco and then say start listening before starting skyrim.

Because this is an alpha it is imperative that people who have problems getting this working, or problems in game with this report back their feedback. This is the point of the alpha. Thanks in advance! Swat



HELP WANTED: Someone who is familiar with the creation kit, TES5EDIT, and notepad++ regex commands. The work entails dumping, cleaning, and sorting item names into appropriate categories so I can get support for all vanilla+DLC items into the engine as soon as possible. Everything is automated except the sorting part. For example here is a list of all relevant item names from just Skyrim.esp:

HELP WANTED: Someone to make a nice professional looking video of SVCE in action.


Spoiler





Requirements:
Microphone
Windows 10 (may work on windows 8 and vista, but untested).

Grimy Plugin
Papyrus Util
SKY UI
SKSE


Installation:
1.) Unzip to skyrim directory.

Getting started
1.) Open VR.exe (Skyrim\SVCE\ directory. I create a shortcut to my desktop).
2.) Click start. This should open windows speech recognition.
3.) In the microphone say "Test quick".
4.) Check Skyrim\SVCE\ for a newly created file called "recognition_out.txt".
5.) Open recognition_out. Inside should read "Test quick\n"

To Run SVCE:
1.) Open VR.exe (in Skyrim base directory).
2.) Click start. This should open windows speech recognition.
3.) Open Skyrim.


Using SVCE:

1.) SUPPORTED COMMANDS:

  • "Equip"/"Unequip" (Weapons, armor).
  • "load" (arrows and bolts)
  • "Use" (Food, Potions and Poisons).
  • "Thuum" (Shouts. Currently only supports shouts spoken in Dhovakiin). 
  • "Cast" (Equipping spells currently supported. Preliminary support for casting fire and forget spells untested).
  • "Exit", "Sheath", "Save", "Map", "Run".
  • Equipment slots. Currently supports "right", "left", "both". 
  • Quantities (1-10)
   
2.) SUPPORTED ITEMS, WEAPONS, ARMOR, SHOUTS, ETC.
  • Alpha .13 supports items whose names are derived from the following lists. The task of adding new items is simple but time consuming. If there are any items in particular you would like in the next release either send me a pm, or leave lists of item names in comments.


Spoiler






3.) MCM MENU: currently you will find the option to change two items in the MCM menu.
a.) 'GO' key: This you can change to any KEY. Note that I have not tested support for mouse.
b.) 'GO' command: DO NOT CHANGE THIS! This will hopefully be for a feature in an upcoming release, if there is enough interest.

4.) USING IN GAME:
a.) To issue a command in game.
I.) Make sure VR.exe is running, and you have clicked start. This means that windows speech recognition is running in the background.
b.) Issue command(s) into microphone.
C.) EVERY COMMAND MUST END WITH THE WORD QUICK! IF YOU DO NOT END THE COMMAND WITH THE WORD QUICK, THE ENGINE WILL IGNORE THE COMMAND!
D.) After command(s) has been spoken into the microphone press the 'GO' key (by default: left ctrl).
E.) The engine should immediately detect and execute the command!

5.) Troubleshooting:
a.) See getting started section and ensure recognition_out is being written to Skyrim\SVCE\
b.) Make sure you are saying "QUICK" after every command.
c.) After command(s) press the 'GO' key to execute the command.
d.) Start VR.exe without skyrim and practice issuing commands. When you speak a phrase into the microphone the speech recognition GUI will 
display the recognized speech. Make sure this recognized output is the phrase you spoke. If the speech recognition software does not recognize your
speech immediately do not give up. The engine can be trained to recognize words, or to omit common false positives VERY EASILY.

6.)Using Windows SAPI:
a.) Windows speech API is a powerful speech recognition for windows.
b.) For words that SAPI is having a hard time recognizing right click on the SAPI GUI and goto "Add word to dictionary". Spell the word and check "Record pronunciation when finished." Click ok. You will then have an opportunity to record the word, listen to the word, or submit the word.
c.) Windows SAPI does not recognize dragon tongue by default, and so you will need to train the engine to recognize words or shouts, peculiar item names, etc.
d.) If you are having problems with false recognition, which means you say one thing, and it keeps giving you the same wrong words. Right click on SAPI GUI and click Omit Word From Being Dictated. Follow the same procedure as in step c.
e.) I found it very useful to train the recognition engine to recognize all of the commands, as well as any words the engine was not recognizing.

7.)Features:
a.) Currently supports a wide variety of commands and items, more items will be added in the future to eventually include all vanilla+dlc content, as well as support for modded content. I was rapidly working on adding support for third party content but due to a lack of interest in alpha testing I decided to wait and see what sort of response I would get with a public alpha before deciding whether to finish this.
b.) You can equip items to the left hand, the right hand, or both! "Equip imperial sword both quick."
c.) You can poison weapons in right hand, left hand, or both! "Use frostbite venom left quick"
d.) Preliminary support for hands free fire and forget spell casting (untested).
e.) Stackable potions (you can say for example: "Use 5 potions of minor healing quick."
f.) Quasi-'intelligent' recognition of incomplete item names. For example if you omit a word from the item name, or you say the item name in the wrong order, the engine should still execute the proper command.

8.) KNOWN BUGS/COMPATIBILITY:
a.) Poisoning left hand and both hands is a bit buggy. I'm still working on this, but I'm confident I can get this working consistently. 

9.) CREDITS:

a.) Maverick for writing the SVCE custom voice recognition app.
b.) IsaharaMeriden, FamilyFrank, Matortheeternal for automation tools and all his work, and all the people on the forums who put up with the too many questions I ask, and all the unnecessary code.
c.) God, through Jesus Christ, because He saved my ass from drugs, the occult, debauchery and what not. Without Him I'd be a draugr. (P.S. Jesus Christ is risen FROM THE DEAD!) If you want to hear my story, drop me a line, or click here to listen to my rap musics.