2003 Ford Crown Victoria Intermittant stiff steering

I have a 2003 crown vic p71 and the steering will get real stiff for a while then loosen back up and repeat every so often. The serpentine belt was worn and streached enough to rub together so I replaced the belt and the fluid level was not an issue. Is this more likely the pump ro the rack and pinion??