Lord and Lady Althorp always had a pressure of having a heir, which ultimately took its toll on their marriage and the couple got divorced. Lady Althorp took Diana away with her but later Lord Althorp won her (Diana's) custody, after which Diana grew up in the Park house, Sandringham estate.