Housing and Urban Development Secretary Ben Carson took on Democrats Tuesday over his latest proposal to end public housing access for illegal immigrants.

Carson said he is upholding Section 214 of the Housing and Community Development Act of 1980, “the Secretary of the Department of Housing and Urban Development (HUD) from making financial assistance available to persons who are other than United States citizens, nationals, or certain categories of eligible citizens either applying to or residing in specified Section 214 covered programs.”

Carson explained to Fox News’ Tucker Carlson Tuesday night that there are millions of Americans waiting to live in these public housing projects.

“The real thing that is hurting people is our failure to address this immigration system that rules that are drawing people here and keeping them here and are so unfair to American citizens who have been paying taxes and working here,” Carson said.

Earlier Tuesday, Carson testified on Capitol Hill and was accused by Democrats of being anti-immigrant. Democrats suggested Carson evaded the current law and called his current plan ‘despicable.’

Carson wrote on Twitter Tuesday: “Rep. Sylvia Garcia, there are more than 100,000 American citizens waiting for public housing in Houston, TX. Do you think they should continue to wait while people here illegally are taking their space?”