In 1880 he married Sibyl Marcia Graham, who died in 1887, leaving him with two daughters. He inherited his father's literary tastes, and published Stray Verses in 1890, besides other miscellaneous literary work. A Liberal in politics, he became private secretary to Lord Granville when the latter was Secretary of State for Foreign Affairs (1883-1884), and in 1886 was made a lord-in-waiting.
In the Liberal administration of 1892-1895 he was Lord-lieutenant for Ireland, having Mr John Morley as chief secretary. In 1895 he was created 1st Earl of Crewe, his maternal grandfather, the 2nd Baron Crewe, having made him his heir. In 1899 he married Lady Margaret Primrose, daughter of the 5th Earl of Rosebery. In 1905 he became Lord President of the Council in the Liberal government; and in 1908, in Mr Asquith's cabinet, he became Secretary of State for the Colonies and Liberal leader in the House of Lords.