When I turn on my turn signals they only flash once (maybe) then stop; what can I do to fix this?

This has been going for awhile now and seems to be getting worse. Initially the signals would maybe just skip a beat, but then after awhile they would stop completely and then come back on and now I'm lucky if they flash even once. I have changed the fuses and bulbs, but that didn't seem to make a difference.