The Chilton House you see today is a result of a complete remodelling that took place between 1740 - 1751.  However archaeologists have found evidence of a previous building dating back to the twelfth century.  What is certainly known is that the Manor of Chilton was given by a grateful William The Conqueror to Walter Gifford in 1066.

The House came into the Aubrey family in 1783 when Sir John Aubrey married Martha Carter the eighteen year old heir to the Chilton Estates.  Sadly they had no children and the Estate passed down the family until in 1903 Sir Henry Fletcher inherited and assumed the Aubrey part of the name.

Chilton was requisitioned during the Second World War and used as a school by an order of Irish nuns.  In 1945 the family decided not to return and the house was rented.  During this period the house fell into a state of disrepair and was nearly pulled down.

In 1987 the Aubrey-Fletcher family bought back their own lease and set about restoring the house to its former glory.