The Department for Communities and Local Government said it has "yet to be convinced" that restrictions would be workable or make property more affordable after a long-awaited report suggested trialling a scheme to force people to apply for planning permission when they turn a property into a second home or holiday let in some areas.

Liberal Democrat MP Matthew Taylor, whom Gordon Brown asked to look into rural affordable housing, said that, although there was "no clear evidence" high numbers of second homes pushed up prices, large numbers of properties standing empty for much of the year could threaten the future of shops and pubs and undermine communities.

"Although there are issues of practicality, there is a case to be made for controlling (through the planning system) further conversion of full-time homes into second homes and holiday lets only in those places where there is identifiable impact on the sustainability of the host community," his report concluded.

"This issue will not go away because it raises genuine concerns in those communities most affected.

"To move forward at all, a trial in one or more of the communities affected would be the necessary next step. The place to do this might be in one of the National Parks."

Growing numbers of second homes, often bought by city dwellers, in some country areas have provoked controversy as villages become increasingly deserted for long spells and lifeline services such as post offices and pubs are put under threat as business dwindles.

Mr Taylor – whose report called for a shake-up of planning and affordable housing policy to revive rural communities – said concern about the impact of second homes had been raised repeatedly during his review, although the properties only account for one per cent of England's housing stock.

Concerns about the impact of second homes prompted a ban to be introduced in 2005 in the Yorkshire Dales national park on new properties being sold to outsiders.

But Mr Taylor's proposals to trial the new powers were played down by the Government which said there were more innovative ways of providing affordable housing without limiting the rights of second home owners.

Paul Rouse, who used to run the Second Home Owners' Association, said work still needed to be done to find out how many rural homes were needed.