Intermittent Starting Issue

I have a 2001 Chevy Cavalier with 85K miles on it. I have a 2.4 L engine I believe. So here's the deal.

I have an intermittent starting problem with the car. Sometimes it starts, sometimes it doesn't. When it doesn't start, it doesn't do anything, the engine doesn't crank at all. All of my dash light come on and everything looks normal. After a few tries the car starts. Sometimes when I start the car, there is a slight hesitation before it revs up. For the past week and a half the car seems to have been fine.

However today after fueling up, I went to start the car, it started but it was accompanied by a bang that sounded like it came from the engine (I don't think it backfired, but can't be 100% positive). So I turned the car off to see if it would start again and nothing. I checked the oil, that's fine. Gave it a few more goes, and still nothing. Tried it again and it started. Got it to my work, turned the car off; tried starting again, it started but sounded really rough.

So I went out at lunch time to see if it would start. I left the door open and the hood up. Turned the key and it didn't start; it didn't crank either. The only thing I heard was a click. Tried a couple more times and got the same thing. Tried again and it started.

I just had it at the dealer for a fuel pump and can't afford to take it back; if anyone can offer up any suggestions I'd appreciate it!