The group began when Anna and a friend, Jenni Konner, began writing short punk songs about boys in her bedroom. Waronker had known Petra and Rachel Haden since high school, so they fluidly found their way in to playing her songs with her. Mutual friend Tony Maxwell picked up the drum duties.
Their first album, which was self-titled, was originally released on a limited run as a double 7" on the independent label Magnatone Records in 1992. It was soon after re-released on cassette and compact disc by Geffen. During this time, the band was good friends with, often played on records by, and toured with label mates Beck and Weezer. Members contributed to the Beck songs "Girl of My Dreams" and "Totally Confused", as well as Weezer's "I Just Threw Out the Love of My Dreams", all released as B-sides by the aforementioned artists.