Former education secretaries and ministers voted out as Conservative Party suffer historic election defeat.