@luckyflyer show us your config and maybe a picture of your print head. I had mixed results with my Orion depending on how I had it mounted.
Originally I had my V6 mounted using the provided mounts on quite a stiff x gantry and I got pretty good results.
I then switched to a Chimera so had to design my own mount. First few iterations I didn't get it right and had big problems with repeatability. I found designing the mount to have stiffness in the right places and flex in others wasnt very straightforward. I also had some issues that the print head was cantilevered off the gantry. This meant that the gantry wasn't very torsionally stiff so the nozzle would be pushed upwards when it hit the bed, reducing my accuracy.
After a few iterations I got it working okay, but eventually switch over to a bltouch as mounting the Orion, chimera and two extruders in the print head was quite heavy and cumbersome.
Are you probing hot or cold? I found I had best result probing with a nozzle at 130C. Hot enough for it to squish any filament drooling from the nozzle, but not hot enough to damage my bed or cause additional drool. J then always did a double probe. One dummy probe to squish any drool 10mm off from my actual probe point, before doing the actual probe.
You can also use the A and S parameters in M558 to make it do repeated probes at each point and take an average. I found this helped a lot in giving more consistent results (though takes a little longer at the start of each print)