David Olusoga traces the house’s fortunes from the late 18th to the mid-19th century, discovering tales of scandal, domestic violence and the asylum.