The village name is Anglo Saxon in origin, and means 'swan stream'. In the Anglo-Saxon Chronicle in 792 the village was recorded as Suanaburna.
The manor in Swanbourne used to belong to Woburn Abbey, but now belongs to Lord Carrington. His daughter now lives there with her husband, politician Iain Duncan Smith.