I alway suspect primary extraction first because it is the easiest to check. Slide in a feeler gauge (or business card or two) between the rear bridge and the rear baffle and see if the condition improves.

Cleaning the extractor hole and parts as well as swapping to a larger ball is a good idea even if you aren't trying to fix a problem.

If it were me, I'd do both.