Finch formed in Temecula, CA in 1999 and released their first EP, Falling into Place in 2001 on Drive-Thru Records. The band's first full-length record, What It Is to Burn, was released in 2002 and has been considered one of the best post-hardcore releases of the 2000's. The album was produced by Mark Trombino (Jimmy Eat World, Blink 182) and features a guest appearance on two songs ("Grey Matter," "Project Mayhem") by Daryl Palumbo of seminal rock band Glassjaw. Finch followed What It Is to Burn with their sophomore record, Say Hello to Sunshine, in 2005 via Geffen Records. Over the next 7 years the band toured and went on various hiatuses until their reformation for the 10th anniversary tour for What It Is to Burn.