Hit bump or pot hole or loose gravel the brake pedal will sometimes lose pressure and drop to the floor

While pressing brake pedal if you hit bump or pot hole or loose gravel the brake pedal will sometimes lose pressure and drop to the floor. After about 3 to 5 days it will start acting normal. They tell me I need a new brake master please help.