One scholar says the effects of more restrictive immigration policy stand to impact the economy at least as much as tariffs.