Got it! Using wireshark I saw a lot of traffic from my PC to my server --> It was running a backup.. Even though I also rebooted the PC today it did not stop the backup. Also I'm not sure exactly when the backup was started, it must have been running since yesterday morning..
To conclude it had nothing to do with duet3d WiFi. Sorry for the inconvenience, now time for some more printing with this awesome board