The epsilon for membership apparently appears for the first time in Peano's "Principles of arithmetic, presented by a new method" (1889). This is translated as the second item in the famous Van Heijenoort anthology, and is also translated in Selected Works, ed. by Hubert C. Kennedy.