How badly did the cannon affect the castle and lead it to it's decline?