1999 Chevy Cavalier Bad lifter: can I disable that cylinder

I have what appears to be a collapsed lifter - there's nearly 1/8" of play in the rocker arm. The car runs OK, but it's pretty noisy. Given the general condition & age of the car, we're going to get another one, rather than pull the head and replace the lifter.

In the meantime, we still need a car to get around.

2 questions:

1. Is there any great downside to just driving it as it is?

2. Would it be better (or even OK) to just disable that cylinder - remove both rocker arms & push rods, and disconnect the injector?

Thanks