The manor of Puddletown (now known as The Old Manor) originated in the medieval period but was altered and considerably extended by the 5th Earl of Huntingdon in 1690. It passed by marriage into the Walpole family in 1724 and remained there until 1861, when it was bought by Capt. John Brymer. The Brymer family owned the manor until 1977, when it passed into new ownership. It changed hands again in 1997 and remains in private ownership.

The gardens retain remnants of earlier historic periods with garden walls and paths, a ha-ha and a fine old avenue of yews that probably dates from the 18^th century, and a Victorian structure of yew hedges. In 1997, the owner wished to restore the gardens, respecting the historic layout, repairing the old garden artefacts and creating a traditional English garden but with vibrant new planting schemes. Research was undertaken into the history of the site and then a master plan and preliminary detailed designs were developed, working closely with the client. The gardens were gradually restored following a phased programme of work, implemented by local contractors and craftsmen. The historic framework of formal avenues and compartments is still defined today by venerable yew trees, paths and the remnants of old walls and structures. The new gardens have been assimilated within this historic structure. New paved areas have been created around to the house, as well as smaller, more intimate spaces, formal walks, water features, herbaceous borders and seasonal gardens.