Sanders was born in Little Rock, Arkansas, under the name Farrell Sanders. He began his professional career playing tenor saxophone in Oakland, California. Sanders moved to New York City in 1962. He received his nickname "Pharoah" by Sun Ra, with whom Sanders performed. He came to prominence playing with John Coltrane's band starting in 1965. He has collaborated with Bill Laswell, Jah Wobble and others.