Chancellor says government wants to make improvements but insists other priorities will take precedence.