Instead consider using particle swarm optimization (PSO) to train your neural network ... found by any of the other particles in the swarm. In very high-level pseudo-code, PSO looks something like ...