Duet 2 Ethernet WC 3.3.0 crashes, have to reset to reconnect
-
No, I did not create a thread. I tried connecting via USB and resetting the network. I still have the same issues with network drop outs. The chip has a sticker of DUET2 Main W06367. This morning I powered on the printer and attempted to print. I have issues loading files to the printer, the network drops out. Nic lights are correct, but the connection drops randomly. It faults more while printing.
13/02/2022, 09:36:19 Failed to upload Desk_Stand.gcode Could not complete action because the connection has been terminated 13/02/2022, 09:36:19 Connection interrupted, attempting to reconnect... Network error 13/02/2022, 09:35:57 Successfully deleted TESTPRINT.gcode 13/02/2022, 09:31:02 Finished printing file 0:/gcodes/TESTPRINT.gcode, print time was 0h 48m 13/02/2022, 09:31:00 Connection established 13/02/2022, 09:31:00 Connection interrupted, attempting to reconnect... Operation failed (Reason: Service Unavailable) 13/02/2022, 09:10:37 Connection established 13/02/2022, 09:10:36 Failed to upload Print-In-Place Phone holder.gcode Could not complete action because the connection has been terminated 13/02/2022, 09:10:36 Connection interrupted, attempting to reconnect... Network error 13/02/2022, 09:08:25 Successfully deleted 2 items 13/02/2022, 08:40:55 Cancelled printing file 0:/gcodes/TESTPRINT.gcode, print time was 0h 5m 13/02/2022, 08:40:46 Resume state saved Warning: Obsolete use of S parameter on G1 command. Use H parameter instead. 13/02/2022, 08:39:01 Connection established 13/02/2022, 08:39:00 Connection interrupted, attempting to reconnect... Operation failed (Reason: Service Unavailable) 13/02/2022, 08:37:36 Connection established 13/02/2022, 08:37:36 Connection interrupted, attempting to reconnect... 13/02/2022, 08:35:33 M32 "0:/gcodes/TESTPRINT.gcode" File 0:/gcodes/TESTPRINT.gcode selected for printing 13/02/2022, 08:35:25 Upload of TESTPRINT.gcode successful after 5s 13/02/2022, 08:35:02 Connected to 192.168.10.6013/02/2022, 09:54:06 m122 === Diagnostics === RepRapFirmware for Duet 2 WiFi/Ethernet version 3.3 (2021-06-15 21:44:54) running on Duet Ethernet 1.02 or later + DueX5 Board ID: 0JD0M-9P6M2-NWNS0-7J9DJ-3SJ6S-K90RJ Used output buffers: 12 of 24 (24 max) === RTOS === Static ram: 23876 Dynamic ram: 73712 of which 0 recycled Never used RAM 13972, free system stack 98 words Tasks: NETWORK(ready,29.2%,231) HEAT(delaying,0.1%,330) Move(notifyWait,0.2%,307) DUEX(notifyWait,0.0%,24) MAIN(running,70.4%,441) IDLE(ready,0.1%,29), total 100.0% Owned mutexes: === Platform === Last reset 00:12:46 ago, cause: power up Last software reset at 2022-02-12 17:20, reason: User, GCodes spinning, available RAM 16828, slot 2 Software reset code 0x0003 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0041f000 BFAR 0xe000ed38 SP 0x00000000 Task MAIN Freestk 0 n/a Error status: 0x0c Aux0 errors 0,1,0 Step timer max interval 0 MCU temperature: min 34.1, current 37.9, max 38.0 Supply voltage: min 23.9, current 24.0, max 24.2, under voltage events: 0, over voltage events: 0, power good: yes Heap OK, handles allocated/used 99/1, heap memory allocated/used/recyclable 2048/86/0, gc cycles 0 Driver 0: position 15650, ok, SG min/max 0/1023 Driver 1: position 754, ok, SG min/max 0/1023 Driver 2: position 4627, ok, SG min/max 0/1023 Driver 3: position 3641, standstill, SG min/max not available Driver 4: position 0, ok, SG min/max 0/1023 Driver 5: position 0, standstill, SG min/max not available Driver 6: position 0, standstill, SG min/max not available Driver 7: position 0, standstill, SG min/max 0/56 Driver 8: position 0, standstill, SG min/max not available Driver 9: position 0, standstill, SG min/max not available Driver 10: position 0 Driver 11: position 0 Date/time: 2022-02-13 09:54:06 Cache data hit count 4294967295 Slowest loop: 175.42ms; fastest: 0.14ms I2C nak errors 0, send timeouts 0, receive timeouts 0, finishTimeouts 0, resets 0 === Storage === Free file entries: 9 SD card 0 detected, interface speed: 20.0MBytes/sec SD card longest read time 1.2ms, write time 50.3ms, max retries 0 === Move === DMs created 83, maxWait 291747ms, bed compensation in use: mesh, comp offset 0.000 === MainDDARing === Scheduled moves 2259, completed moves 2229, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 1], CDDA state 3 === AuxDDARing === Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1 === Heat === Bed heaters = 0 -1 -1 -1, chamberHeaters = -1 -1 -1 -1 Heater 0 is on, I-accum = 0.2 Heater 2 is on, I-accum = 0.5 === GCodes === Segments left: 1 Movement lock held by null HTTP is idle in state(s) 0 Telnet is idle in state(s) 0 File is doing "G1 X81.698 Y83.929 E304.1846" in state(s) 0 USB is idle in state(s) 0 Aux is idle in state(s) 0 Trigger is idle in state(s) 0 Queue is idle in state(s) 0 LCD is idle in state(s) 0 Daemon is idle in state(s) 0 Autopause is idle in state(s) 0 Code queue is empty. === DueX === Read count 1, 0.08 reads/min === Network === Slowest loop: 202.93ms; fastest: 0.02ms Responder states: HTTP(0) HTTP(0) HTTP(0) HTTP(0) FTP(0) Telnet(0), 0 sessions HTTP sessions: 2 of 8 Interface state active, link 100Mbps full duplex -
@trobison Just to ensure we've covered all the bases, do you have another SD card to test with?
-
@phaedrux This is a replacement card. I went through the online configurator to get the most recent stable version. Do you require another SD card? If so, can I image the existing card? There are a lot of files for the tool-changer.
After a reboot, I was able to upload some jobs straight away. I used the screen to submit the jobs without issue. The network issues are random. Somethings worse, other times it's good. -
@trobison Switching to a new SD card is simple matter of copying all the folders and files across. Provided the old card still works.
-
@phaedrux I prepared a new SD Card (SanDisk Extreme). I copied all files to the new card, and the Duet booted. I left the machine on for 6 hours, and recorded only one disconnect. Then a test print was sent to the printer, which
completed without error. The machine was powered off after that. The following day, I turned on the printer, No SD Card found. I took the card out and reinserted it. Same response. I put the card into a card reader and I could see all contents. I replaced the card with the SD card I had earlier (this is a replacement card as well). I still get network drop outs. Network cables have been changed, and the switch has been changed. Having the DuePanel has proved useful for this issue. -
@trobison Do any of the chips on the ethernet module get extremely hot to the touch?
-
@phaedrux I have a little more diagnostic info. During the last print I tried to make changes to my toolchanging routines. The network drop outs prevented this during printing. After the print I could make some changes but still having random drop outs. I open up a new Enterprise HP Switch as a test. There are only two ports in use on this 24 port switch. While working on tpre0.g the network dropped and cleared all contents in the file. This has happened 6 times today; changing the switch and network cables have not had an effect. Cycling the DUET is the only way to return comms. Thank goodness I have a DuePanel to see what is going on. It is becoming challenging to use my ToolChanger.
-
I photographed the network chip with my thermo camera - it reports 53 degrees. The network has failed minutes into a print. I can't see the webpage. "Connection lost" I swapped switches back, and it is not available on this switch as well. I can see the printing status on the DuePanel. There are pauses in the print to insert nuts, but I can't locate layer lines on the panel. Hopefully it pops up a message on the screen of the duet.
-
@Phaedrux I have been printing items every day this week and have yet to experience a third connection drop with the new board. I am fairly sure the issue has not magically resolved but nothing new to report at this time. Have not heard back from anyone on the Warranty department as of yet. Hopefully once the first board gets back it can be analyzed.
-
@airscapes @trobison Can you both send an email to warranty@duet3d.com with your name and address? We will send out a replacement ethernet module.
-
@phaedrux Sure is it replaceable without soldering or will the board need to be removed to R&R the module? Truthfully never looked that close to see how it was installed.
Hum... looks to just plug into headers.. maybe should have done and R&R on the first board that was acting up constantly.. @trobinson, have you done this on your board? Just removed it and reinstalled it to see if there was any change?
-
Yes it's a small module that can be removed.
Perhaps as part of the exploration could you grab some close up shots of it? Perhaps there is a solder point that is suspect.
-
@phaedrux Sure, once it shows up I will pull the board from the machine and see what I can see. I was just looking at the image of it in the getting started guide and saw it was plugged into headers so 2 solder joints for every connection.
Just wish mine would act up on a regular basis.. Trobinson seems to be having issues constantly. I will email MatterHackers and see if my original has made it back home. -
@Phaedrux Duet has mailed the module .. will travel across the pond so I guess it will take a while to arrive..
-
Module arrived today, will try and replace this weekend. I have had a total of 3 network failures since replacing the the board so not real often..
-
@Phaedrux I have installed the new Network Module. This second board has only failed 3 times that I know of making it very hard to diagnose. I did take photos of the solder joints of the header to board on both the old and new module as well as the top and bottom of the main board. I also looked a the surface mounted components on the module .. none of the joints look like they were cold or had large amounts of inclusions.. The photos are here.
Photos of Solder joints magnified
Now the waiting .. -
@Phaedrux Connection dropped once after replacement.. does not look like that fixed it.. Workaround using usb to disable/enable networking did work. I give up!
Will just live with it unless it starts happening much more frequently. Can't trouble shoot if it can not be reproduced on demand.. -
@Phaedrux Connection dropped again (2 times today) This time I check the monitor all was well, pulled out the print bead, Knocked off the print job with the spatula, looked at the monitor no issue. Went to fit the part, then back to the PC in the other room and now we are disconnected. Logon to octoprint and disable/enable network via usb and back in business. Seem like new module is worse than the original or it has nothing to do with the module. Well keep trying to find a way to make it fail on demand. Any of those solder joints look like an issue to you? (see previous post)
-
I didn't see any glaring issues on the photos of the soldering.
If it's happening with the new module as well I'm not sure what else to say. We've replaced the entire board and the module itself. Logically it would seem to be an issue inherent to the local network or the printer setup. Did you happen to break a mirror in the last 7 years?
-
@trobison said in Duet 2 Ethernet WC 3.3.0 crashes, have to reset to reconnect:
I open up a new Enterprise HP Switch as a test. There are only two ports in use on this 24 port switch. While working on tpre0.g the network dropped and cleared all contents in the file.
Does the switch have some kind of power saving that puts it in to standby until it sees traffic??
Or, if the only other thing connected is your computer, does that have power saving enabled on the Ethernet port?
I know some machines do shut down ports when idle and the wake-up time can cause lost packets - which in theory are automatically re-sent, but that relies on a normal network driver stack..
If you are only using two ports on the switch, can't you use a direct cable & omit the switch, at least for testing?
Also, you say you are "pulling the bed out" - does that cause any motor(s) to rotate??
If it does, that could be affecting or even damaging the Duet board, as the back EMF from an externally turned motor [acting as a generator] feeds back in via the driver electronics.Robert J.
Printers: Overlord pro, Kossel XL+ with Duet 6HC and "Frankentron", TronXY X5SA Pro converted to E3D toolchange with Duet 6HC and 1LC toolboards.
