The ByWard Market building then burned to the ground in the 1860s and had to be rebuilt as the city around it changed ...