Hard to say without seeing it There’s no trick to it...bout as straight forward as can be. The retaining pin is splined to bite into the hole, but it should press out fairly easy. It only goes in & comes out ONE WAY. The pin has a head & splines on one end to keep it from going all the way through. Are you pushing in on the ejector to take the forward momentum off the pin? I always do in habit, as to keep the ejector & spring from shooting out. But I’ve never noticed if the forward weight of the ejector “holds” more tightly to the retention pin.