@Phaedrux @engikeneer
I set the jerk and accel values as recommended by @engikeneer and this almost completely got rid of the ringing/ghosting. There is still a slight hint of it visible but it got a lot better. The slicer now also shows the correct time, which is only off by a minute or two at most for small prints.
Thanks everyone for the advice!