Installed new ignition switch, cannot remove key

I just put a new ignition switch in my car and the key won't come out! With the old switch, you would push it in a little and then rotate it back to position 0 to remove the key, but this one won't go back past position 1. It'll rotate to positions 2 and 3 just fine to start and run the car, but it won't go back to position 0 for key removal. Did I install it wrong, is it a defective switch, or is something else causing the problem?