1995 GMC Truck Will not shut off with key while running

I have replaced the starting switch key,it will crank an run ,But will not shut off.i can unhook the battery
cable and replace the cable it work fine untill i start the engine then it will not shut off with key.