I suggest raising the Z jerk to M566 Z60 and trying again.
The low jerk values means that as the Z height changes with the heightmap the XY axis has to slow down to give time for the Z axis to move since it has to obey the lowest value.
Reducing the first layer speed can also help.