The Berkeley family, who still own Berkeley Castle in Gloucestershire, can trace their ancestry to the mid-11th century prior to the Norman Conquest.