Refugee advocates say that people fleeing desperate situations in their home countries are being turned into pawns in an immigration fight between the federal government and New Brunswick.