Rattling sound coming from underneath the passenger side - Catalytic converter?

When driving everything seems fine until I come to a stop light and then a rattling sound comes from underneath the passenger side, it's where the exhaust goes through. I have checked to make sure it isn't loose and it isn't, but it only does this in drive or first and second after driving and comes to a stop still in that gear.