Since disabling the viewing of comments from the file page last night the server has no not crashed once, which is telling. Part two of my plan has been to implement a button that you need to click to view the latest file comments. Upon clicking the button it'll take a few seconds to load the latest comments, but after that everything will look as it did before.
Hopefully this will reduce load on the server as not everyone wants to view the latest file comments.
I shall continue to monitor the situation throught the day.