Bramber Castle, in the village of Bramber, on the north side of the South Downs, is just one spot that dates back centuries.