Shifting into reverse is hard

When vehicle is running, and I try to put truck into reverse, I hear grinding, and have to wait till idle speed slows down in order to get truck into reverse. This grinding only happens while trying to put into reverse. The truck had been sitting for many years. I am able to put truck into reverse easy when eng. Is not running.