Yeah. Bonding epoxy to metal is difficult under the best of circumstances. Using a cheap epoxy like J.B. Weld further reduces your chances of success.
Do like I did (and many others) Drill and tap for a couple of 6/32 grub screws like this: http://i41.tinypic.com/14xctgp.jpg
Adjust them in and out to get the extraction you're looking for, being sure the parts are not skewed. Then use a drop of Locktite and you're good to go.
Bookmarks