Bomb disposal units were called to the house on Ashleigh Road at 8.55am this morning (Wednesday) following the discovery.
South Yorkshire Police said the device was thought to be a WW2 explosive.
Officers are at the scene with the property cordoned off and an army unit has also been summoned to take care of the device.
The public has been urged to stay away from the area for the time being.
Support The Yorkshire Post and become a subscriber today. Your subscription will help us to continue to bring quality news to the people of Yorkshire. In return, you'll see fewer ads on site, get free access to our app and receive exclusive members-only offers. Click here to subscribe.