Jackson, Lewis, and Clarke had originally played together in a quartet while in the Dizzy Gillespie orchestra from 1946 to 1950. Together with Ray Brown they played in interludes designed to give the trumpeters time to recover from the challenging upper register trumpet parts. The same group recorded as the Milt Jackson Quartet in 1951.
Jackson and Lewis originally shared the role of musical director but Lewis eventually took over the entire responsibility of this position.
The group occasionally played with classical musicians, but its repertoire consisted mainly of bop and swing. Among its original compositions are "Django" by Lewis and "Bags' Groove" by Jackson.
Jackson left the group in 1974 because he was tired of touring, and the group soon disbanded. In 1981 the group reorganized. Their last recording was issued in 1993. Heath is the only surviving original member.