Skills minister acknowledges commitment to reducing net migration is causing ‘competing priorities’ in UK government.