The Castle is both a getaway and the bastion for the minutemen. With more deterrent entries, that last battle with the synths will be more in your favor... Unless of course they spawn inside the castle ¯\_(ツ)_/¯