A surgeon by profession, Kalocsay published his first collection of original poems in 1921, Mondo kaj Koro (World and Heart). During the 1920s and 1930s, he was the editor of the literary magazine Literatura Mondo ("Literary World"), which became home to an influential group of authors who came to be collectively known as the Budapest School.
In 1932, using the pseudonym of "Peter Peneter", Kalocsay released a book of erotic verse entitled Sekretaj Sonetoj ("Secret Sonnets"); perhaps more prosaic but no less remembered was his Plena Gramatiko de Esperanto ("Complete Grammar of Esperanto"), co-written with Gaston Waringhien in 1935.