Both of my rear door handles broke?

Both of my rear door handles broke. I replaced them. All was fine for a few days. Then the driver's side rear would not open from inside or outside. Took the panel off and got the latch open. Open and closed it numerous times from the outside and was good. I opened and shut from inside by grabbing the little ball that attached to the inside door handle, and that worked. Reassembled the door and could not open from in or out again. Took apart again and same thing, worked until I Reassembled it.