The body was found in open land off Carlisle Street, in the north of the city, this morning.
Police received a call shortly before midday.
Police and ambulance officers were sent to the scene after reports a man's body had been found.
A South Yorkshire Police spokesperson said there were no suspicious circumstances surrounding the discovery of the body.
They were unable to comment on the age of the body.