“Earliest source located is the book Brighter than a Thousand Suns: A Personal History of the Atomic Scientists by Robert Jungk (1958), p. 249, which says that Einstein made the comment during "a walk with Ernst Straus, a young mathematician acting as his scientific assistant at Princeton.”

Source: Wikiquote