Yes, the lords of Hanging Blade built the Palace of Annals. They must have had urgent reasons for leaving.