The Pilgrims initially trailed 1-0 but led 2-1 at half-time courtesy of Jair Minors’ effort and Jordan Neil’s penalty.
Neil’s second successful spot-kick handed United a 3-2 lead on 68 minutes, but Newark equalised with 15 minutes to play to ensure parity once again.