Built under Louis XVI as the military governor's palace, it is the most imposing building on the esplanade.