In 1708 Humphrey Prideaux, dean of Norwich, wrote:

Such a statement immediately raises the questions: how had the earl descended to this condition; how far was it his fault; and, since he lived for another twenty-four years, what did he do with the rest of his life?

The career of the 2nd earl of Yarmouth has been seen as a brief inglorious epilogue to the history of the Paston family. Only the barest outline of his financial debacle has been known, as virtually none of his own papers have survived. Since, however, his career is documented in official archives and private letters, and the sale catalogue of his library reveals much about his intellectual life and interests, there is enough information for a reappraisal of this shadowy figure to be attempted. Unlike Yarmouth himself, his family is one of the best documented in English history. Their fifteenth-century correspondence, known simply as the ‘Paston Letters’, documents the rise of the family from modest beginnings. They proceeded to acquire land, to enter the service of the crown and to make advantageous marriages, becoming by the early seventeenth century the richest gentry family in Norfolk, with estates stretching across Norfolk and into Suffolk.

The family seat was originally at Paston Hall, on the north-east coast of Norfolk, but in 1598 Clement Paston, one of the gentleman pensioners, died without heirs and left his share of the family estate at Oxnead to his nephew, together with a large modern house built some twenty-five years previously on a south-facing site overlooking the river Bure; though built with the traditional great hall, screens passage and buttery, it also contained extensive private apartments.