Victory was achieved for the loss of two wickets and defeat was England’s first series loss on home soil since 2014, when they were overturned by Sri Lanka, and the Black Caps’ first success here in 22 years.
England were 122 all out when Stone poked Trent Boult behind, with England rounded up inside 42 overs.
Stuart Broad ensured the day’s play would not be a dead loss for the fans who had turned up, finding Devon Conway’s outside edge to send the opener back for just three with his fifth delivery.
Stone managed to take one more batsmen with him when he entered the attack, Will Young dragging the ball into his stumps from outside off, but the cause was lost.
Tom Latham, captaining in place of Kane Williamson, ended things in the 11th over nudging Mark Wood off his hips to level the scores then slashing him to the third-man boundary to seal it.