Gourevitch was born in Philadelphia, Pennsylvania, to painter Jacqueline Gourevitch and philosophy professor Victor Gourevitch, a translator of Jean Jacques Rousseau. He and his brother Marc, a physician, spent most of their childhood in Middletown, Connecticut, where their father taught at Wesleyan University from 1967 to 1995. Gourevitch graduated from Choate Rosemary Hall in Wallingford, Connecticut.

Gourevitch knew that he wanted to be a writer by the time he went to college. He attended Cornell University. He took a break for three years in order to concentrate fully on writing. He eventually graduated in 1986. In 1992 he received a Masters of Fine Arts in fiction from the Writing Program at Columbia University. Gourevitch went on to publish some short fiction in literary magazines, before turning to non-fiction.