1999 GMC Yukon grinding noise

i get a grinding noise in my rear end when i hit a bump pretty hard. sometimes it grinds until i almost stop the truck or sometimes it is very short and goes away quick. it only happens when the back tires go over the bump. My father in law thinks it could be the brakes. maybe a loose caliper or rotor. there is no grinding noise any other time.