Bypass A/C pulley

On the 4 cylinder you should only need a much shorter belt that runs where the red lines are. On the V6 there are other pieces in the way so you need the pulley to rout the belt around them. On the 4 cylinder the belt should be able to run behind the A/C pulley instead. If you use a wrench to move the tensioner and remove the belt you can use it to test that fit by running it that way and see if it clears the A/C pulley. If not you could remove the A/C compressor to get the room needed, however finding the belt length will be harder as I don't see anything listed as a bypass belt. So it will take a few tries to find the right one, you could take the old belt and rig up a way to hold the tensioner in place like it is with the current belt, then cut the belt, route it around the pulleys and staple it at the right length, then get a belt that length or the next one smaller.
However you should know that the A/C is also used as part of the defrost system as it dries out the air helping the defroster operate better.