The Whites scored early via Rodrigo, but then conceded in stoppage time in what looked to condemn them to further dropped points.
However, youngster Joe Gelhardt proved to be the hero, as he came off the bench to score the winner just three minutes later.
Meanwhile, down in the second tier, it was a weekend of mixed fortunes for Yorkshire's sides. Huddersfield Town picked up a point away to West Brom, Sheffield United were hammered by Coventry City, while Hull City and Barnsley secured draws in their respective clashes as the relegation battle continues to develop.
Speaking after the Norwich game, Whites boss Jesse Marsch said: “I feel like I played 96 minutes.
“There's a lot of emotion in the late stages of the match. I heard a lot about the magic of Elland Road, it was certainly an incredible experience. They asked me before will I remember this in two weeks. I said on my deathbed.
“The last moments of the game you really feel the energy. Throughout the game, the difference between Villa and this was we performed with confidence and aggression and quality and it brought the crowd into the game and gave them something to root for and be attached to."
Take a look at the latest news and transfer stories from Yorkshire and further afield, as the reaction to last weekend's action continues.

5. Lincoln eye Blades stopper
Lincoln City could be set to make a move for Sheffield United goalkeeper Jake Eastwood. According to reports, the club are looking for an emergency loan deal, and could have found their answer with the ex-Portsmouth loanee. (LincolnshireLive) | Getty Images

6. Wilder names transfer priority
Middlesbrough boss Chris Wilder has revealed he’s target a left-footed centre-back ahead of the summer transfer window. The club were linked with Rangers’ Jack Simpson in January, but a deal failed to come to fruition. (Football League World) | AFP via Getty Images

7. Ex-Fulham boss lands new job
Ex-Fulham boss Felix Magath has been named the new Hertha Berlin boss until the end of the season. He once famously suggested that star Cottagers defender Brede Hangeland could look to treat a thigh injury with cheese. (Club website) | Getty Images

8. Baggies want Gayle back
West Brom have been tipped to move again for Newcastle United striker Dwight Gayle in the summer. The out of favour striker has been linked with the Baggies for some time, and starred for the club previously on loan during the 2018/19 campaign. (Sunday Mirror) | AFP via Getty Images


