He was the son of Prime Minister Terauchi Misatake. He attending the Japanese Military Academy and after graduating in 1900 he joined the Japanese Army. Terauchi spent time in Germany and worked as a lecturer at the Military Academy before taking command of the 5th Division and the chief of staff of the Korea Army. Later he become head of the Formosa Army.
In October 1935 he was promoted to full general. Two years later he was the army's choice as war minister. He returned to the Japanese Army when he was given command of the North China Theater Army. Terauchi took control of the Southern Army on November 6 1941 and soon afterwards began devising war plans with Admiral Yamamoto Isoroku.
After leading the conquest of the Southern Area he established his headquarters in Singapore. Promoted to field marshal, he moved to the Philippines in May 1944. When this area came under threat he retreated to Saigon. Upon hearing of the loss of Burma by Japan, he suffered a stroke on May 10 1945. He subsequently surrendered to Lord Mountbatten and died in a prisoner of war camp.