A lot depends upon the rifles' stock, and another important factor that steveinwv brought up... What feels good to you.

I like to have the scope down low if possible because I'm a natural stock crawler, but on some rifles that has either not been possible ( AR15 ) or it just didn't feel right.

As far as I can tell, the only kind of rifle where having the scope really low is critical is on a .22LR, or maybe a .17HMR where you will occasionally shoot at very close range. For small game at very close range, having the scope mounted high will tend to make you shoot too low. ( Assuming a 50-100 yd zero )

For big or medium game hunting, all of this is not really much of an issue at all, as long as you don't tilt the rifle over while shooting, or something weird like that.

If it feels good, you're on the right track.