A graduate from the Indian Institutes of Technology (BS in Electrical Engineering) and Carnegie-Mellon University (Masters in Biomedical Engineering), Khosla was one of the original founders of Sun Microsystems. He founded Sun along with his Stanford University fellows Scott McNealy, Andy Bechtolsheim (another Carnegie-Mellon University graduate school alumnus), and a UC Berkeley masters degree holder named Bill Joy.
Khosla always dreamt of being a millionaire as early as possible and so left Sun Microsystems in 1985 when he chased his dreams. Currently he is a general partner of the venture capital firm Kleiner, Perkins, Caufield & Byers, where he has been since 1986.
Khosla is also one of the founding fathers of The Indus Entrepreneurs (TiE).