Morrowind

Multipart upload functionality for large file authors

  • Comment
One of the issues with the Nexus sites has always been the 300mb file size limit for files. It meant that authors with files larger than this amount would have to split the files up in to multiple parts before they could be uploaded to the site. To make matters worse the part names were renamed by the file upload process that screwed up the multipart functionality meaning the end user would have to manually rename the files once they were all downloaded. There was no way of grouping up the parts under one file entry either so these files ended up looking cluttered and disorganised.

To remedy this there are now new options for all file uploaders to help facilitate the multipart upload process. While slightly complicated these new features will enable large file authors to upload their multipart archives without the files losing their multipart extensions, meaning no more manual renaming of files by the end user. Similarly all parts of a single file will now be grouped together for easy downloading.

In related news there's also a new "version" field for all file uploaders. The file version will display under the file details and will also be added to the filename that user's download.

Tidbit of info for anyone who didn't know: the files you download from the site won't come with the original file's name included because they can often be long, and long file names plus deep saving directories equals problems in many operating systems. However the file ID is included in the filename. The file naming process goes <filename>-<fileid>-<version>.<ext><br><br>If you extract the <fileid> portion of the file name you can tap that in to the site using the URL http://www.TheSiteI'mUsing.com/downloads/file.php?id=<fileid> and hey presto, that's the file entry you downloaded from.<br><br>Please let me know any bugs with the new upload process.</fileid></fileid></ext></version></fileid></filename>

36 comments

Comments locked

A moderator has closed this comment topic for the time being
  1. XTR3M368
    XTR3M368
    • supporter
    • 92 kudos
    I am having issues with the second part of my 2 part download. I am getting a site error that says "a file with that name already exists on the site". I have tried renaming the file, renaming the text name of the upload and no joy. I did have a service interruption while uploading the second file. Am I going to have to delete the first one and redo both from scratch now?

    started from scratch and got them up but when you download them, they don't correctly combine back into a DAZIP. I am just going to do it the old way and put two files up for download.
  2. psychophat
    psychophat
    • member
    • 28 kudos
    Nice work guys keep it up!

    Now I need to make a mod that's 301MB for me to be happy.
  3. olafreinhardweyer
    olafreinhardweyer
    • member
    • 90 kudos
    Excellent! I appreciatte your hard work
  4. LHammonds
    LHammonds
    • supporter
    • 1,189 kudos

    What I was initially concerned about and now still am is the way to recombine them, it's certainly not automatic for me and presently I have your 3 part Wiki as well as my 2 part esm sitting on my desktop.

    The 'Windows cannot open this file' message comes up, am I 7z illiterate?

    You don't double-click the .001 file. You right-click on it and from the 7-Zip menu, select Extract to... or Extract files or Extract here or Open Archive

    If you put all the archive files into their own directory and select Extract here for the .001 file, it will extract all the files in .001 and then look for the exact same filename but with a .002 extension and then process all the files in it....and so on.

    With 7-Zip, you can do it several different ways and it just depends on how you like to operate. I personally use the Extract to ... option so it creates a nice sub-folder to hold all the extracted files but that's just me. Some people like to open the archive and navigate the 7-Zip Manager program. Those old dogs like myself that are quite familiar and comfortable at a command prompt (DOS), you could even use the 7za.exe command-line version to extract the files (just flexin my nerd knowledge, please don't direct people to use the command line if you don't have to...hehehe)

    LHammonds
  5. lyobovnik
    lyobovnik
    • premium
    • 25 kudos
    Fantastic. One of my mods is pretty large and the renaming of the multipart archive apparently confuses the hell out of a lot of people. ::shrug:: IDK why. This should help
  6. MERPTeam
    MERPTeam
    • member
    • 34 kudos
    Update:

    I've uploaded the present public MERP Middleearth.esm in two parts just like you've done/instructed, it took a very long time!

    I also have downloaded the Wiki and my esm and have the same format for both except of course you have three parts.

    What I was initially concerned about and now still am is the way to recombine them, it's certainly not automatic for me and presently I have your 3 part Wiki as well as my 2 part esm sitting on my desktop.

    The 'Windows cannot open this file' message comes up, am I 7z illiterate? Stating the obvious: this file has to be 'fool-proof' for the masses, any further insight/help would be greatly appreciated.

    ...and in the darkness bind them. ~sorry I couldn't resist
  7. LHammonds
    LHammonds
    • supporter
    • 1,189 kudos
    You can have a 6,000 MB archive and still be able to upload it.

    You say that you have a 700 MB ESM. If you use 7-Zip and compress it in .7z format using the Ultra settings, how large is the 7z?

    Once you tell me how large the 7z file is, I can tell you exactly how many 290 MB parts you will have to upload.

    The article I linked you to explains the step-by-step instructions for creating a multi-part archive. However, with Dark0ne's new upload feature, the last portion of my article is invalidated. Once you create the .001, .002 and .003 split files, you can upload them directly rather than wrapping them inside standalone zip files.

    The UESP Wiki I uploaded is over 1.6 GB in size when extracted and about 750 MB compressed. Since 750 MB is over the 300 MB Nexus limit, I re-zipped the 1.6 GB and told it to not create any files over 190 MB...which created 2 190 MB files and a left-over 150 MB file.

    LHammonds
  8. MERPTeam
    MERPTeam
    • member
    • 34 kudos
    LHammonds

    Thanks for the detailed reply but I'm still unclear if I can specifically upload: a 700+MB ESM and split it in three though, it sure sounds like it. 7z only?

    I don't wish to create any further confusion for members acquiring our big ESM, so I'm a little apprehensive. (presently I'm using a mirror)
  9. Zaldiir
    Zaldiir
    • Moderator
    • 477 kudos
    Yeah, it's a bit more complicated and takes some more work for the user than normal uploading, but I just thought I should mention it. <img class=">
  10. LHammonds
    LHammonds
    • supporter
    • 1,189 kudos

    I also want to specify that you can upload files larger than 25Mb on PES, using ftp. <img class="> (You should add that to the List of Online Hosting Sites, Lon.)

    Ok, I added a mention about FTP which I already knew about...that's why I said 25 MB by default since you really have to communicate to the admin to find the FTP address, credentials and how to go about getting them to link up together. Not exactly user-friendly and has been problematic in the past (such as with the Lost Paladins upload). But my point was that even with a 25 MB maximum size limit, it is still quite possible to upload split archives even if the site does not support it directly...just so long as they allow multiple files to be attached.

    LHammonds