Disadvantaged Year 6 pupils are nearly four times more likely to say new maths concepts make them nervous, research finds.