1995 Honda Accord Distributor Cap/Distributor Leaking Oil

I have replaced the distributor O-ring on this vehicle already. I thought The only thing is that it is leaking oil from inbetween the main distributor housing, and the plastic distributor cap. The only thing is, I took off the distributor cap before, and there is only oil on the bottom of distributor and cap. There is a gasket that goes inbetween these two. Now my question is, if I replace this gasket will this stop the leak? Because the car runs just fine, however I cleaned where the oil was dripping down from the distributor/cap assembly. I checked it after running the car about 15 minutes doing some errands and there was fresh oil, not that much but it was still leaking. Does this mean I have to replace my distributor, or just the gasket? I hope not, please any help would be greatly appreciated.