Idler arm

The idler arm (tension pulley) bounces up and down when the engine is running. I replaced the tension assembly but it is still bouncing. After taking off the serpentine belt it seems like the power steering pulley is not spinning as free as it should. Do I need to replace the whole power steering pump and pulley or just the pulley? The power steering works fine. Thank you for any advice.