Millet was born in Mattapoisett, Massachusetts and studied at Harvard and the Royal Academy of Fine Arts in Antwerp. He became a well regarded American Academic Realist. He was a member of the American Fine Arts Commission, and a Director of the American Academy in Rome. He was decorations director for the World Columbian Exposition in Chicago in 1893.
He also worked as a journalist and published a number of short stories.