He studied theology in Qum, Iran. There he got involved in the mujahideen resistence movement against the Russians in Afghanistan. He was one of the leading figures in unifying the Hazara resistance parties into one unified party, Hizb-i-wahdat (Unity Party). This party played a leading and positive role in voicing and fighting for the oppressed Hazara people of Afghanistan. During the civil war it held all the Hazara-populated areas in Afghanistan. He was highly respected figure among the Hazaras, for he had given them a voice and pride, he was affectionately called Baba (father) Mazari and Ustad (teacher) Mazari.
During the seage of Kabul, the Talibans lured him for negotiations and then brutally killed him in front of camera. His funeral procession march on foot from Kabul to Bamiyan and then Mazar-i-Sharif, where he was buried.