It was first recorded in 1217 as Cealf, an Old English word meaning "Calf Island".
There is a local legend about the "Chalvey Stab Monkey" involving an organ grinder and a stabbed monkey; the first person to get blind drunk on the anniversary of the monkey's funeral is declared "Mayor of Chalvey".