The social and political contexts in many countries are affected by dangerous trends and forces of populism. Populist hostility is most observable in connection with issues of immigration, where it functions as a pretext for scrapping legal protections in increasingly hostile immigration laws. What is particularly insidious about these developments is the claim, articulated by some theorists, that the popular resentment and backlash against immigrants and refugees are justified. That populists are hostile towards immigrants and human rights laws, the claim seems to go, is the fault of the legal norms and institutions that allow in the immigrants and protect them. This article challenges those approaches and argues that legal constraints on popular biases towards immigrants are necessary and need to be defended against popular moralism. It is also argued that although community values are important, they should not be considered as trumps against the rights of immigrants and refugees.