There is know way to keep it on axis without a pilot hole that is very well centered. When drilling a soft material with something even slightly harder in the same hole the drill will want to drift. An extrememly rigid setup with an end mill might do better but the setup cost would be prohibited.

I see you have a parallel thread on the hide. Some really strong DIY and professionals there.