1998 Other Saturn Models Car stalls after starting

The Saturn would not start last week. Wouldn't turn over at all. The problem was determined to be the starter which was replaced. We also replaced the battery since it was old. For about 10 days the car ran with out any problems. Clealry the old starter was a problem. But today the car started and then immediately died. It then took a few trys for the engine to catch. It eventually started and was driven home (with a slight rumble initially). There is still something wrong but I don't know what? Thanks