Earlier on, Guiseley nearly took the lead after a neat counter-attack, with Emile Sinclair finding Gavin Rothery who just fired wide.
At the other end, Chester’s Ross Hannah went close from 25 yards out, but Guiseley goalkeeper Steven Drench was equal to the task.
James Hurst then found himself clean through on the visitors’ goal, but his effort was straight at Jon Worsnop.
The visitors took the lead just before half-time when Hannah hit a powerful drive past Drench.
Guiseley’s Gavin Rothery had two efforts when just outside the area, with Worsnop denying him on both occasions.
The hosts then grabbed an equaliser when, from a corner, Emile Sinclair headed into the top corner of the net from close in. Guiseley were then 2-1 up when a ball across the face of the goal was tapped in by Will Hatfield, although there was little time to celebrate, as Kane Richards quickly scored to level the scores up.
Guiseley edged ahead in added time when Sinclair grabbed his second, but there was heartbreak moments later when Tom Shaw nicked a point.
Guiseley: Drench, Toulson, Parker, Lockwood, Lawlor (Norburn 57), Rothery (Johnson 70) Hatfield, Sinclair, Atkinson, Dudley (Hall 90) Hurst. Unused substitutes: Boyes, Craddock.
Chester: Worsnop, Higgins, Hunt, Rooney, Heneghan, Shaw, Hughes, Astles, Lloyd, Alabi (Richards 80), Hannah. Unused substitutes: Thompson, Hobson, Mahon, O’Brien
Referee: Richard Wigglesworth (South Yorkshire).