grinding noise even when not pushing on the brake pedal after the caliper bracket bolt came off?

I recently changed my front brakes. Pads and rotors. Somehow, the caliper bracket bolts came out of the driver's side and caused the caliper to grind on the inside of the wheel. I was able to fix this problem just fine. Now my driver side only has a grinding noise even when not pushing on the brake pedal. When I take a right-hand corner, the sound stops and comes back the more I go back to straight. It also gets louder when I am turning to the right. It confuses me because everything is back where it was supposed to be and tight.