Concern about immigration is a “manufactured panic”, a campaign group has said after polling suggested only a quarter of people think it is an important issue locally..