Union fears remaining staff will face even heavier workloads as 500 jobs have already been lost over past two years.