Dang it man! It could be possible that you went too far to begin with and now the spring doesn't haven enough force to hold the ejector against the case.

Are you certain you filed the correct end of the notch?