The village is named after one of the first Anglo Saxon settlers of Britain, Horsa, who settled in Kent in the Fifth century. It is unlikely that he owned land in this part of the country as the Saxons didn't conquer this part of Britain until the following century. however it is likely that the village is named in his honour.
The parish church is dedicated to St Michael and All Angels.