A quarry and the first stone buildings were built in the town.