Why does my 5th gear slip out of gear while driving

When I put my manual trans-axle into 5th gear and drive on down the road. It will slip out of gear by its self. I notice that it does it sometimes when the rpms drop a little. Also sometimes the lower gears are hard to shift into.