The backbench MP has been heavily criticised for travelling to Australia to take part in the ITV jungle survival show while the Commons was sitting.
Speaking to reporters at Heathrow Airport, Ms Dorries defended her decision.
“I’ve had three sitting days away from Parliament. The rest has been over half-term,” she said.
“There are still MPs who have been away for two weeks and still haven’t returned. I’ve had three sitting days away. I think that is an important thing to remember.”
When asked about the reaction of some of her constituents in Mid Bedfordshire, she replied: “What they are angry about is what they have read in the newspapers, which is not the truth.”
Ms Dorries, who was the first contestant voted off the programme last week, had initially been expected to stay in Australia until next month.
Tory Chief Whip Sir George Young has suspended the party whip, and summoned her for a meeting to explain her actions.
But Ms Dorries denied she was about to have such a meeting, and added: “The Press are giving the impression the whip has been withdrawn. It hasn’t.”
A source close to Sir George said Ms Dorries had been “very clearly” informed in a letter that she was suspended pending their meeting.
That meeting is expected to happen “soon”, according to the source.