James came with his mother and sister, arriving in New York on 23 June 1864 via the ship The General McClellan.