The city of Bromjunaar

Have you ever walked trough the Labyrinthian while doing the College of Winterhold quest and wondered on how no one re-settled the place after so much time? The place is situated between Solitude and Whiterun, two of the most economically influential place in Skyrim, it would seem only logical that someone would take control of this place!