Hard staring issue?

Common problem. 99% of the time it is caused by the EVAP purge valve being stuck open. That lets the fuel vapors from the tank dump directly into the engine as you are filling the lank and it creates a mix that is very rich and will not ignite. Holding the pedal down allows more air in to dilute the mixture so it will start.
Without knowing the engine, it will be hard to be specific but here are the images for the 1.8 and the 2.4 They are both very easy to replace with just a few hand tools. Basically, disconnect the hoses and connectors and unbolt them. Reverse the process to put the new one on.

Thank you so much. We originally replaced that due to the car telling us the code that was wrong, however, since the problem persisted, we ended up replacing the fuel pump itself. Still did the same thing. So, is it possible the EVAP we bought was faulty or is it possible we put it in wrong? Also, it is a 1.8 Honda Civic LX I greatly appreciate it.

Easy to test the part. Remove the valve and try to blow through it. With it disconnected it should be closed and not let anything through. I've seen bad ones right out of the new box.
I would test it first.

We had to replace the EVAP again, it was open when we removed it. Put a new one in and it's all better. Thank you so much, man.

Good to hear you found it and got it running properly. If you have any other vehicle questions we will be here. Thank you for using 2CarPros.