The school's sports teams are known as the Lord Jeffs. The name is derived from Lord Jeffrey Amherst, commanding general of British forces in North America during the French and Indian War. The school participates in the NCAA's Division III, the New England Small College Athletic Conference, and the Eastern College Athletic Conference.
Amherst is one of the "Little Three", along with Williams and Wesleyan.