Hard to start

Sometimes I can turn the key and nothing happens I can hold it in the start position and eventually it cranks right up. I can hold it anywhere from thirty seconds to two minutes but it always starts eventually. Any ideas? I tried changing starter solenoid switch under hood no good, replaced alternator and battery, but nothing seems to help. I was wondering if the ignition switch or starter might be the issue?