No it isn't the fuel pump. It is most likely the fuel pressure regulator is leaking. It is designed to hold pressure in the system so when you are ready to start your car there's fuel already at the injectors for the engine.
When the FPR leaks, it allows the pressure to bleed off back to the tank when you shut the car off. Also, if the diaphram is leaking, it will allow the fuel to be sucked into the intake manifold where it shouldn't be. Thus your backfires.
SPONSORED LINKS
Saturday, February 5th, 2011 AT 12:21 PM