"It was nice to put a smile on people's faces again down here," said manager Ronnie Moore.
"There has been too much moaning really. Okay, we have not been great at home recently but look where we are, we're in a great position pushing for promotion.
"This was a must-win game really against a side wanting the same as us and we fully deserved a win, no doubt about it."
They had to wait until 10 minutes from time for the clinching goal from Josh Walker, the on-loan midfielder from Middlesbrough, who followed up his first goal for the club in midweek.
Launch the Yorkshire Post's Coca-Cola Football League video player
"He has the ability to score from distance and we've been encouraging him to have a go," added Moore.
Walker's goal was set up by determined work from Marcus Marshall and Danny Harrison before Walker lined up a sight of goal 20 yards out and he sent his shot into the far corner.
Marshall had kept his place on the right flank despite Nicky Law being fit again and the on-loan winger justified the decision. Law returned but on the left flank for virus victim Kevin Ellison.
Rotherham should have led early on when defender Ian Sharps put a close-range chance over the bar but it was a game of few opportunities.
The home side did most of the attacking throughout the second half and Marshall brought a good save from Wayne Brown.
Bury, under former Millers chief Alan Knill, were disappointing as an attacking force but nearly grabbed an undeserved equaliser in stoppage time when Andy Morrell's header hit the top of the bar.
Rotherham United: Warrington; Tonge, Sharps, Fenton (Mills 20), Gunning; Marshall (Broughton 90), Harrison, Walker, Law (L Bell-Baggie 75); McAllister, Le Fondre. Unused substitutes: Annerson, Lynch, Roberts, Pope.
Bury: Brown; Buchanan, Sodje (Cresswell 54), Futcher, Newey; Warrall, Dawson, Barry-Murphy, Jones (Racchi 65); Parker (Morrell 73), Elliott. Unused substitutes: Belford, Scott, Hewson, Bishop.
Referee: M Russell (Herts).
Man of the match: Marcus Marshall.
This season the Yorkshire Post has an exciting new match-day service, called Match Centre. Here you will find minute-by-minute updates, stats and team formations. Plus reports from every game in England, from the Premier League down to the Blue Square Premier.
Simply select your game from the pull down menu, then click on the 'i' information button on the right of the fixture and it will give you access to everything you need to know about your team.
So if you can't make it to a game, head for the Match Centre and we will give you the best seat in the house. Click the link below.
For the latest team news, score and commentary from your team check out our new Match Centre