Thank you for creating this. Can you recommend any programs for replacing the voice files in the game? I'm trying to replace one character's voice with my own voice, but the same words. Is there a way to do that?
A really handy function for this to be used with Xedit is to copy the Dialogue itself and put it into a self created .esm and the audio and lip files into a folder. I think .esm rather than .esp is because you wont have to monkey with the load order before Xedit. We could open the .esm and our mod in Xedit and do a "Deep Copy As Override Into" into our mod and remove the new dependency in the header. Then copy our quest info into the newly copied dialogue so they are referenced by our quest in Xedit. Save and load both the .esm and our mod into this tool and rename .esm audio/lip files to the .esp. After that it is CS/GECK/CK work on conditions and such and copy the files to our mods sound folder. I am doing that manually as it is in about that process but ever so slowly.
(Note on that process use ridiculously high EDID/REFID numbers in the .esm that way Bethesda's editor doesn't break something when it discovers two identical ID's and we wont need to renumber them in Xedit before copying. You could use that ID number to compare between the .esm and .esp for the renaming of the audio/lip files.)
This tool is Grand powerful & useful !! Tested it just now and it works perfectly like charm :D (still not test to full extent yet) thank you for sharing this !
Thank you for the update ! this definitely will help me in my modding project, even though Oblivion is old. I am happy that there's much people that still care... I noticed that this tool can convert mp3 into WAV and that's wonderful, if possible, could you also make this mod generate LIP file ? that would be very delight if it can be realized~
Hi lubronbrons, Thank you for the warm words. I am very glad to hear that. Oblivion is now a classic but definitely a masterpiece, and it is nice that the modding community is still active The matter of LIP, I always thought of the same thing as you. However, the file format of LIP is still unknown, and unfortunately I don't have the ability to decipher it.
well it seems Shademe can, please see this CSE page and navigate to bug with title 'Cant generate more than 2 lip files' by reading those messages, I could assume Shademe successfully reverse engineer / dechiper LIP thingy in CSE version 7.0 but things go south when he upgraded CSE into 8.0 (that bug report, he confirmed it) if it is not too much maybe you should contact him, but you have to be patient because Shademe is very very slow response person. or no reply at all... nevertheless, he is considered the Godfather of Oblivion modding~
Thank you for useful information! I looked at the source code of CSE, there was a process to create LIP. CSE seems to have launched an old version of CS and some hacks to generate LIP. Amazing technique! As far as I know, it is a wonderful feature as it should have bugs that can not make LIP on the latest CS. Perhaps it is difficult to obtain permission to use his code due to differences in software licenses. But it is possible to provide a function to invoke another application in LVF, and call LIP generation command based on CSE or CSE itself. I am going to investigate whether there is a method to make CSE 8.0 generate LIP with command line parameters etc.
such spirit plus passion and good soul you have there, and a goodwill too~! it is good news indeed. I will support you as much as I can about source code permission, I think I know where to get. I suggest you should contact user llde he is active nowadays, and I think you might get fast reply from him~ the more of it, he is in OBSE team in this timeline so he is definitely working with Shademe. maybe he might know a way to contact Shademe effectively I think (?) I really hope you could get permission to use LIP function from CSE, because I myself using CSE 7.0 not 8.0 sadly latest version CSE 8.X is Not compatible in my setup, I did troubleshooting with several experts but stuck with no avail solution so if you could implement LIP generator in LVF, that would be the best outcome. so it can be compatible with other CSE version I think I decided to stay long in version 7.0 because it is much much faster and stable than 7.1 release, and I heard from a friend that 8.X version is better at render thingy, which I do Not need for majority of my projects I am a heavy scripter, but when it comes to modeling I am very noob~ CSE 8.X is more like intended for designer and modeler user. in my BSS mod project, I did use Batch generate LIP from CSE 7.0 and it is working just splendidly fine. it can be accessed via CSE Menu -> Character -> Batch Generate LIP Files several notes from me : - the file must be in folder "..\Sound\Voice\" with correct esp folder name, and the extension must be WAV not mp3 for LIP generation, dunno why - make sure the sound quality is WAV 44100 Hz, 64 kbps cbr (constant bit rate), channels: mono - I noticed a bug, if WAV length is less than 400 ms, the CSE Batch LIP will fail or ctd if I'm not wrong, or not generated at all (I forgot, but I think it is this one) - LIP generated from CSE is not 100% mouth movement accurate but it is Jolly better than nothing :)
First, the software licensing is very complicated and rigorous. CSE's license is WML 1.0 (I don't know), it contains GPL's source, so it's definitely GPL-compliant. Since my tool itself is not an open license, it is impossible to get LIP code permission under GPL regulations. Besides, another libraries I use may not be compatible with GPL. It is best to make LVF an open source, but for the moment I do not intend to do so.
Anyway, I use CSE's source to see if I can actually create a lip. And I will contact them if I can create it as another tool. I am not familiar with C ++ and also have many other translation projects, please understand that it will take some time. This is a very interesting task as I thought that it was stupid to start CS (CK) only for LIP generation. It will probably not work in another game such as Skyrim, but it is still a valuable task.
Several notes about LIP from me : - The audio files that LIP can generate is limited to WAV with very limited format. This is a limitation of the LIP generation engine, and it is the same in the latest Beth games such as FO4 and Skyrim SE. It is technically possible to convert to the appropriate format on the tool side. - WAV length is less than 400 ms: I did not know the problem, but perhaps this is also a limitation of the LIP generation engine. This should also be excluded by checking on the tool side. - Accuracy of mouth movement: Yes, this is maybe the limitation of the LIP generation engine. Originally, audio analysis using speech recognition technology is necessary to estimate mouth movement from audio files, but probably the LIP generation engine has not done so far. In my opinion, the only thing the LIP engine does is to determine the movement of the mouth from the text and the timing of the mouth movement from the audio. Otherwise it can not be generated faster than that. Although it is a very simple method, I believe it is realistic when considering creating a large amount of LIP. It is better than nothing as you say . And it is the same in the latest Beth games such as FO4 and Skyrim SE.
hmm... this is very weird... now I think this mod is VERY underrated ! lol I could hear your passion loud and clear with your message just now, Thank you for still attempting to realize LIP generator function, Bow... alright ! just take your time, you should do it whenever you feel like it have kudos mate~ translation ?? if you want I have this batch scripting skill in TES4Edit that could detect foreign text, maybe I could help if you want..
Thanks lubronbrons (^_^) Underrated? That might be the case but this is a tool only for mod authors in the first place and it is such a thing. Still, users are increasing little by little, and people who credits on mod page have also increased. This is enough for me
I originally jumped into modding from Japanese translation of mods of Skyrim. All I came to be able to read English is thanks to mods (but I'm really bad to write and still rely on Google ;-) I have created this tool to translate vanilla based voice files such as Unofficial Patch into Japanese (like this).
TES4 does not have Beth Official Japanese version and the play environment in Japanese is not well prepared so unfortunately I will not translate TES4 mods. But one thing came up now. For now LVF does not support TES4's multilingual dialogue text columns, but does anyone want to display English and French text simultaneously? If there is such users, may be able to retrieve texts such as French and German from esm beforehand and display them in LVF. To do that I need your help (you seem to be a xEdit wizard). Of course this is just an idea and I don't plan on doing it without a needs.
To someone reading this, feel free to comment if you need these features.
hey Bow, please if you don't mind I prefer to be called L it's my fav nick in Nexus (several modders and users here already know)
yeah as long as the tool is xEdit series whether TES4Edit or TES5Edit or other xEdit series tools, I could handle it. all of it is using pascal language and somehow I unexpectedly good at it (learn by doing trial & error) this batching thingy is pretty handy almost in most situations, in my case BSS is the mod where I used batch scripting the most so if you want I could be some helps. and I think you could contact Shademe nowadays, just now he replied to me regarding bug fix in CSE. and he did fix it ! yay!!
Hello dreamed1, Thank you for your kind words. Actually, I'm editing custom voices with this tool right now, time is saved very much Please use the tool for making a wonderful work
I've needed something like this for so long! It's ridiculous how long I'd spend searching through the files, looking for a single word. Now it's finally going to be quick and easy to find words, thanks to this wonderful program
Thanks elderscrolliangamer, Actuary I was exactly the same idea as you, and I was lazy so I wanted to have some easier! That is the reason for developing this tool, and exactly the tool for you
Hello fredlaus, Thanks for your kind words. As you can see in the description, the basic idea comes from Voice File Reference Tool for Skyrim by greentea101, so please give thanks to him too (Of course the implementation is totally different and I have added a lot of my own ideas). Anyway, Just have a FUN
It was about time that someone made a program like this, it was just what I needed to search out vanilla dialogue and create custom voice files for my marriageable Baurus mod. So thanks a bunch! This was the result. (I know, my sound editing isn't the best )
Hi T3alrose, Thank you for kind words. and lovely movies!I developed this tool just to make such a mod Editing consecutive voices is very difficult, but there are a few tricks. Use Audacity to split the previous and afterwards voices into different channels, fade out previous voices, fade in afterwards, and mix it. It should be quite smooth.
Thanks, I'll keep that in mind next time I decide to generate custom voice files <3 I also loved how your mod automatically opens a voice file in Audacity.
Give Feedback
28 comments
Thank you for your positive feedbacks and endorsements. Happy modding!
Also see the sticky post on the Skyrim page for the latest information : https://www.nexusmods.com/skyrim/mods/82482?tab=posts
(Note on that process use ridiculously high EDID/REFID numbers in the .esm that way Bethesda's editor doesn't break something when it discovers two identical ID's and we wont need to renumber them in Xedit before copying. You could use that ID number to compare between the .esm and .esp for the renaming of the audio/lip files.)
Tested it just now and it works perfectly like charm :D (still not test to full extent yet)
thank you for sharing this !
this definitely will help me in my modding project, even though Oblivion is old. I am happy that there's much people that still care...
I noticed that this tool can convert mp3 into WAV and that's wonderful,
if possible, could you also make this mod generate LIP file ? that would be very delight if it can be realized~
Thank you for the warm words. I am very glad to hear that. Oblivion is now a classic but definitely a masterpiece, and it is nice that the modding community is still active
The matter of LIP, I always thought of the same thing as you. However, the file format of LIP is still unknown, and unfortunately I don't have the ability to decipher it.
please see this CSE page and navigate to bug with title 'Cant generate more than 2 lip files'
by reading those messages, I could assume Shademe successfully reverse engineer / dechiper LIP thingy in CSE version 7.0
but things go south when he upgraded CSE into 8.0 (that bug report, he confirmed it)
if it is not too much maybe you should contact him, but you have to be patient because Shademe is very very slow response person. or no reply at all...
nevertheless, he is considered the Godfather of Oblivion modding~
Perhaps it is difficult to obtain permission to use his code due to differences in software licenses. But it is possible to provide a function to invoke another application in LVF, and call LIP generation command based on CSE or CSE itself.
I am going to investigate whether there is a method to make CSE 8.0 generate LIP with command line parameters etc.
and a goodwill too~!
it is good news indeed. I will support you as much as I can
about source code permission, I think I know where to get. I suggest you should contact user llde
he is active nowadays, and I think you might get fast reply from him~
the more of it, he is in OBSE team in this timeline so he is definitely working with Shademe.
maybe he might know a way to contact Shademe effectively I think (?)
I really hope you could get permission to use LIP function from CSE, because I myself using CSE 7.0 not 8.0
sadly latest version CSE 8.X is Not compatible in my setup, I did troubleshooting with several experts but stuck with no avail solution
so if you could implement LIP generator in LVF, that would be the best outcome. so it can be compatible with other CSE version I think
I decided to stay long in version 7.0 because it is much much faster and stable than 7.1 release, and I heard from a friend that 8.X version is better at render thingy, which I do Not need for majority of my projects
I am a heavy scripter, but when it comes to modeling I am very noob~
CSE 8.X is more like intended for designer and modeler user.
in my BSS mod project, I did use Batch generate LIP from CSE 7.0 and it is working just splendidly fine.
it can be accessed via CSE Menu -> Character -> Batch Generate LIP Files
several notes from me :
- the file must be in folder "..\Sound\Voice\" with correct esp folder name, and the extension must be WAV not mp3 for LIP generation, dunno why
- make sure the sound quality is WAV 44100 Hz, 64 kbps cbr (constant bit rate), channels: mono
- I noticed a bug, if WAV length is less than 400 ms, the CSE Batch LIP will fail or ctd if I'm not wrong, or not generated at all (I forgot, but I think it is this one)
- LIP generated from CSE is not 100% mouth movement accurate but it is Jolly better than nothing :)
First, the software licensing is very complicated and rigorous. CSE's license is WML 1.0 (I don't know), it contains GPL's source, so it's definitely GPL-compliant. Since my tool itself is not an open license, it is impossible to get LIP code permission under GPL regulations. Besides, another libraries I use may not be compatible with GPL. It is best to make LVF an open source, but for the moment I do not intend to do so.
Anyway, I use CSE's source to see if I can actually create a lip. And I will contact them if I can create it as another tool. I am not familiar with C ++ and also have many other translation projects, please understand that it will take some time. This is a very interesting task as I thought that it was stupid to start CS (CK) only for LIP generation. It will probably not work in another game such as Skyrim, but it is still a valuable task.
Several notes about LIP from me :
- The audio files that LIP can generate is limited to WAV with very limited format. This is a limitation of the LIP generation engine, and it is the same in the latest Beth games such as FO4 and Skyrim SE. It is technically possible to convert to the appropriate format on the tool side.
- WAV length is less than 400 ms: I did not know the problem, but perhaps this is also a limitation of the LIP generation engine. This should also be excluded by checking on the tool side.
- Accuracy of mouth movement: Yes, this is maybe the limitation of the LIP generation engine. Originally, audio analysis using speech recognition technology is necessary to estimate mouth movement from audio files, but probably the LIP generation engine has not done so far. In my opinion, the only thing the LIP engine does is to determine the movement of the mouth from the text and the timing of the mouth movement from the audio. Otherwise it can not be generated faster than that. Although it is a very simple method, I believe it is realistic when considering creating a large amount of LIP. It is better than nothing as you say
this is very weird... now I think this mod is VERY underrated !
I could hear your passion loud and clear with your message just now,
Thank you for still attempting to realize LIP generator function, Bow... alright ! just take your time, you should do it whenever you feel like it
have kudos mate~
translation ??
if you want I have this batch scripting skill in TES4Edit that could detect foreign text, maybe I could help if you want..
Underrated? That might be the case but this is a tool only for mod authors in the first place and it is such a thing. Still, users are increasing little by little, and people who credits on mod page have also increased. This is enough for me
I originally jumped into modding from Japanese translation of mods of Skyrim. All I came to be able to read English is thanks to mods (but I'm really bad to write and still rely on Google ;-) I have created this tool to translate vanilla based voice files such as Unofficial Patch into Japanese (like this).
TES4 does not have Beth Official Japanese version and the play environment in Japanese is not well prepared so unfortunately I will not translate TES4 mods. But one thing came up now. For now LVF does not support TES4's multilingual dialogue text columns, but does anyone want to display English and French text simultaneously? If there is such users, may be able to retrieve texts such as French and German from esm beforehand and display them in LVF.
To do that I need your help (you seem to be a xEdit wizard). Of course this is just an idea and I don't plan on doing it without a needs.
To someone reading this, feel free to comment if you need these features.
please if you don't mind I prefer to be called L
it's my fav nick in Nexus (several modders and users here already know)
yeah as long as the tool is xEdit series whether TES4Edit or TES5Edit or other xEdit series tools, I could handle it.
all of it is using pascal language and somehow I unexpectedly good at it (learn by doing trial & error)
this batching thingy is pretty handy almost in most situations, in my case BSS is the mod where I used batch scripting the most
so if you want I could be some helps.
and I think you could contact Shademe nowadays, just now he replied to me regarding bug fix in CSE. and he did fix it ! yay!!
Please use the tool for making a wonderful work
Actuary I was exactly the same idea as you, and I was lazy so I wanted to have some easier! That is the reason for developing this tool, and exactly the tool for you
Nice result from your hand as well T3.
Thanks for your kind words. As you can see in the description, the basic idea comes from Voice File Reference Tool for Skyrim by greentea101, so please give thanks to him too (Of course the implementation is totally different and I have added a lot of my own ideas).
Anyway, Just have a FUN
Thank you for kind words. and lovely movies!I developed this tool just to make such a mod
Editing consecutive voices is very difficult, but there are a few tricks. Use Audacity to split the previous and afterwards voices into different channels, fade out previous voices, fade in afterwards, and mix it. It should be quite smooth.