Heavenly debuted with "I Fell in Love Last Night", followed by "Our Love Is Heavenly", both released in 1990 on Sarah Records. Heavenly Vs. Satan, the group's debut album, came out in 1991.
Before releasing the critically acclaimed Le Jardin de Heavenly, Cathy Rogers (keyboard, back-up vocals) joined the band. The band's second LP was The Decline and Fall of Heavenly (1994), followed by Operation Heavenly (1996). Later that year, Matthew Fletcher, the band's drummer, committed suicide. The band broke up, but announced that they would continue using the name Marine Research.