Duet 3 Mini 5+ VIN under-voltage issues in SBC mode

[Serbitar]

After the previous failure I dropped the SPI rate to 2MHz but that hasn't helped. Printer just stopped while doing G29 with the dreaded under-voltage event.

[dc42]

@Serbitar, thanks for the additional data point.

[ukwebb]

@lodger No i haven't, as @Serbitar has already said its not fixed the issue

[droftarts]

@Serbitar I've been running 'air' prints on my test rig today. I've had one under-voltage event, 1h 18m into a 3h 30m print, but running the same exact file and settings did not provoke another. So trying to get to the bottom of this issue is, unfortunately, taking some time.

Ian

[Serbitar]

@droftarts Yeah. I haven't worked out a pattern yet. Please let me know if I can do any useful testing.

[lodger]

@droftarts When DC42 ask on Saturday I also printed the same file without issue .

I have been printing around the clock up till Tuesday. Again without issue. There is just no patten.

I have one of the first batch of boards, and on a earlier firmware (dont ask what one).
I am sure i had this happen in standalone mode. So since Tuesday i have been printing non stop trying to prove this.

I have to say though i am getting bloody sick of all these massive 3dbenchy boats lying around my living room. lol

[dc42]

I have put new firmware at 2021-03-26 10:59:15. Those of you who have experienced this issue and have an idle machine, please can you try it and do a print (an air print will do, no need to waste filament). If you get a VIN undervoltage event, please post a M122 report. M115 should report firmware date 2021-03-26 10:59:15 for this build.

[Serbitar]

@dc42 Same dropbox link as the previous one?

[dc42]

I'm sorry, i forgot to include the link. It's probably the same as the previous one, but here it is again: https://www.dropbox.com/sh/6203euyyobllic5/AABTHIbn7F_maK9p-oy7vq3Ea?dl=0.

[Serbitar]

Sadly another failure, with the new firmware.

FIRMWARE_NAME: RepRapFirmware for Duet 3 Mini 5+ FIRMWARE_VERSION: 3.3beta2+1 ELECTRONICS: Duet 3 Mini5plus WiFi FIRMWARE_DATE: 2021-03-26 10:59:15

I still have

  "SpiFrequency": 2000000,

Mar 26 19:28:05 ender3 DuetControlServer[13516]: [error] === Diagnostics ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1 running on Duet 3 Mini5plus WiFi (SBC mode)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Board ID: W4ZW4-V296U-D65J0-40KM0-LR03Z-H6928
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Used output buffers: 2 of 40 (12 max)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === RTOS ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Static ram: 100008
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Dynamic ram: 98412 of which 24 recycled
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Never used RAM 45260, free system stack 114 words
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Tasks: Linux(ready,145) HEAT(delaying,299) CanReceiv(notifyWait,943) CanSender(notifyWait,358) CanClock(delaying,340) TMC(notifyWait,109) MAIN(running,310) IDLE(ready,20) AIN(delaying,258)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Owned mutexes: Autopause(MAIN)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Platform ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last reset 01:52:11 ago, cause: software
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last software reset at 2021-03-25 17:02, reason: User, none spinning, available RAM 45656, slot 1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Error status: 0x00
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux0 errors 0,0,0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux1 errors 0,0,0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: ADC conversions started 3353356, completed 3353355, timed out 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Supply voltage: min 0.0, current 24.2, max 24.8, under voltage events: 2, over voltage events: 0, power good: no
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 0: position -8051, standstill, SG min/max 0/0, read errors 0, write errors 2, ifcnt 10, reads 16127, writes 18, timeouts 29, DMA errors 0, failedOp 0x41
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 1: position 612, standstill, SG min/max 0/88, read errors 0, write errors 2, ifcnt 12, reads 16131, writes 20, timeouts 23, DMA errors 0, failedOp 0x72
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 2: position 2703, ok, SG min/max 0/272, read errors 0, write errors 2, ifcnt 20, reads 16145, writes 28, timeouts 0, DMA errors 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 3: position 0, ok, SG min/max 0/424, read errors 0, write errors 2, ifcnt 20, reads 16069, writes 28, timeouts 76, DMA errors 0, failedOp 0x72
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 4: position 0, standstill, SG min/max 0/406, read errors 0, write errors 2, ifcnt 20, reads 16144, writes 28, timeouts 2, DMA errors 0, failedOp 0x6a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 5: position 0, ok, SG min/max 0/102, read errors 0, write errors 2, ifcnt 20, reads 16125, writes 28, timeouts 20, DMA errors 0, failedOp 0x41
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Driver 6: position 0, ok, SG min/max 0/118, read errors 0, write errors 2, ifcnt 20, reads 15081, writes 28, timeouts 1064, DMA errors 0, failedOp 0x6a
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Date/time: 2021-03-26 19:28:05
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Cache data hit count 4294967295
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Slowest loop: 202.38ms; fastest: 0.08ms
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Storage ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Free file entries: 10
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SD card 0 not detected, interface speed: 0.0MBytes/sec
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SD card longest read time 0.0ms, write time 0.0ms, max retries 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Move ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: DMs created 83, maxWait 122533ms, bed compensation in use: mesh, comp offset 0.000
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === MainDDARing ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Scheduled moves 99196, completed moves 99196, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === AuxDDARing ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Heat ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Bed heaters = 0 -1, chamberHeaters = -1 -1
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heater 0 is on, I-accum = 0.0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Heater 2 is on, I-accum = 0.6
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === GCodes ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Segments left: 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Movement lock held by Autopause
Mar 26 19:28:05 ender3 DuetControlServer[13516]: HTTP* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Telnet is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: File* is doing "G1 X-58.264000 Y-6.812000 E0.479440" in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: USB is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Trigger* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Queue* is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: LCD is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SBC is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Daemon is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Aux2 is idle in state(s) 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Autopause is ready with "M122 M115 M913 X0 Y0 G10 P0 R0 S0 G10 P1 R0 S0 G91 M83 G1 Z3 E-5 F10000" in state(s) 71
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Code queue is empty.
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === Filament sensors ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Extruder 0 sensor: ok
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Extruder 1 sensor: ok
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === CAN ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Messages queued 60589, send timeouts 60586, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last cancelled message type 30 dest 127
Mar 26 19:28:05 ender3 DuetControlServer[13516]: === SBC interface ===
Mar 26 19:28:05 ender3 DuetControlServer[13516]: State: 0, failed transfers: 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Last transfer: 11ms ago
Mar 26 19:28:05 ender3 DuetControlServer[13516]: RX/TX seq numbers: 6654/6655
Mar 26 19:28:05 ender3 DuetControlServer[13516]: SPI underruns 0, overruns 0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Number of disconnects: 0, IAP RAM available 0x11458
Mar 26 19:28:05 ender3 DuetControlServer[13516]: Buffer RX/TX: 1192/2488-0
Mar 26 19:28:05 ender3 DuetControlServer[13516]: G0/G1: insufficient axes homed
Mar 26 19:28:06 ender3 DuetControlServer[13516]: [debug] Requesting update of key move, seq 86 -> 87
Mar 26 19:28:06 ender3 DuetControlServer[13516]: [warn] VIN under-voltage event (0.0V)

[dc42]

@Serbitar, thanks for that report. I'm sorry that this is not resolved yet. The M122 report shows no ADC timeouts, which tells me where not to look for the problem.

[dc42]

I've put another firmware build at https://www.dropbox.com/sh/kc7bxqp0s2jjoks/AACf_aOUtEMa8Ix9HXU41hQla?dl=0 to try to pin this down further. Again, if is is convenient, please install it and do an air print to see if the issue still occurs.

[Serbitar]

Thanks for your continued support! I have installed your latest build.

Conveniently I'm currently printing batches of smaller parts so no major loss if the printer stops mid way through one of them.

[lodger]

Afternoon,

Sorry to say i have had undervolt again. This time network fully locked up. and i had to plug in a keyboard and monitor to get the M122 off . So sorry about the txt file

M122.txt

Web page ,SSH and remote desktop fully stopped.

[dc42]

@lodger, thanks for that. It's a useful data point, because it eliminates another aspect of the hardware and firmware that is only used when there is an attached SBC.

[Serbitar]

Tripped over the issue again:

Mar 27 21:49:17 ender3 DuetControlServer[22051]: [error] === Diagnostics ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: RepRapFirmware for Duet 3 Mini 5+ version 3.3beta2+1-swcrc running on Duet 3 Mini5plus WiFi (SBC mode)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Board ID: W4ZW4-V296U-D65J0-40KM0-LR03Z-H6928
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Used output buffers: 2 of 40 (12 max)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === RTOS ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Static ram: 100008
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Dynamic ram: 98124 of which 0 recycled
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Never used RAM 45572, free system stack 123 words
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Tasks: Linux(ready,145) HEAT(delaying,299) CanReceiv(notifyWait,943) CanSender(notifyWait,358) CanClock(delaying,340) TMC(notifyWait,109) MAIN(running,354) IDLE(ready,20) AIN(delaying,258)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Owned mutexes: Autopause(MAIN)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Platform ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last reset 00:29:07 ago, cause: software
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last software reset at 2021-03-27 21:20, reason: User, none spinning, available RAM 45476, slot 2
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00000000 BFAR 0xe000ed38 SP 0x00000000 Task Linu Freestk 0 n/a
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Error status: 0x00
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux0 errors 0,0,0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux1 errors 0,0,0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: ADC conversions started 870319, completed 870319, timed out 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Supply voltage: min 0.0, current 24.1, max 25.0, under voltage events: 2, over voltage events: 0, power good: no
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 0: position -7822, standstill, SG min/max 0/0, read errors 0, write errors 2, ifcnt 10, reads 17204, writes 18, timeouts 2, DMA errors 0, failedOp 0x6a
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 1: position -7466, standstill, SG min/max 0/38, read errors 0, write errors 2, ifcnt 10, reads 17204, writes 18, timeouts 1, DMA errors 0, failedOp 0x72
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 2: position 3887, ok, SG min/max 0/248, read errors 0, write errors 2, ifcnt 18, reads 17196, writes 26, timeouts 0, DMA errors 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 3: position 0, ok, SG min/max 0/422, read errors 0, write errors 2, ifcnt 14, reads 17183, writes 22, timeouts 17, DMA errors 0, failedOp 0x72
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 4: position 0, ok, SG min/max 0/408, read errors 0, write errors 2, ifcnt 14, reads 17194, writes 22, timeouts 8, DMA errors 0, failedOp 0x01
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 5: position 0, ok, SG min/max 0/100, read errors 0, write errors 2, ifcnt 14, reads 17195, writes 22, timeouts 5, DMA errors 0, failedOp 0x41
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Driver 6: position 0, ok, SG min/max 0/114, read errors 0, write errors 2, ifcnt 14, reads 16657, writes 22, timeouts 543, DMA errors 0, failedOp 0x41
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Date/time: 2021-03-27 21:49:16
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Cache data hit count 2632939525
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Slowest loop: 179.79ms; fastest: 0.08ms
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Storage ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Free file entries: 10
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SD card 0 not detected, interface speed: 0.0MBytes/sec
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SD card longest read time 0.0ms, write time 0.0ms, max retries 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Move ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: DMs created 83, maxWait 62634ms, bed compensation in use: mesh, comp offset 0.000
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === MainDDARing ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Scheduled moves 19881, completed moves 19881, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 4], CDDA state -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === AuxDDARing ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Heat ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Bed heaters = 0 -1, chamberHeaters = -1 -1
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heater 0 is on, I-accum = 0.0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Heater 2 is on, I-accum = 0.6
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === GCodes ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Segments left: 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Movement lock held by Autopause
Mar 27 21:49:17 ender3 DuetControlServer[22051]: HTTP* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Telnet is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: File* is doing "G1 X-85.899002 Y-87.926003 E0.377730" in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: USB is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Trigger* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Queue* is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: LCD is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SBC is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Daemon is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Aux2 is idle in state(s) 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Autopause is ready with "M122 M115 M913 X0 Y0 G10 P0 R0 S0 G10 P1 R0 S0 G91 M83 G1 Z3 E-5 F10000" in state(s) 71
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Code queue is empty.
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === Filament sensors ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Extruder 0 sensor: ok
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Extruder 1 sensor: ok
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === CAN ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Messages queued 15731, send timeouts 15728, received 0, lost 0, longest wait 0ms for reply type 0, peak Tx sync delay 0, free buffers 17 (min 17)
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last cancelled message type 4514 dest 127
Mar 27 21:49:17 ender3 DuetControlServer[22051]: === SBC interface ===
Mar 27 21:49:17 ender3 DuetControlServer[22051]: State: 0, failed transfers: 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Last transfer: 10ms ago
Mar 27 21:49:17 ender3 DuetControlServer[22051]: RX/TX seq numbers: 1055/1056
Mar 27 21:49:17 ender3 DuetControlServer[22051]: SPI underruns 0, overruns 0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Number of disconnects: 0, IAP RAM available 0x11458
Mar 27 21:49:17 ender3 DuetControlServer[22051]: Buffer RX/TX: 240/1728-0
Mar 27 21:49:17 ender3 DuetControlServer[22051]: G0/G1: insufficient axes homed
Mar 27 21:49:17 ender3 DuetControlServer[22051]: [warn] VIN under-voltage event (0.0V)

[dc42]

@serbitar thanks, that confirms that the latest change did not help.

[PaulHew]

I am also experiencing this issue.

My machine was not doing anything, Just completed a heater tune. Below are the last 3 entries in the log.

28/03/2021, 19:03:05 	Warning: VIN under-voltage event (0.0V)
28/03/2021, 16:17:33 	Edit the M307 H0 command in config.g to match this. Omit the V parameter if the heater is not powered from VIN.
28/03/2021, 16:17:33 	Auto tuning heater 0 completed after 4 idle and 7 tuning cycles in 1336 seconds. This heater needs the following M307 command:
 M307 H0 R0.853 C250.9 D5.98 S0.60 V23.9

Pi has a dedicated PSU. Mini 5+ is power by a 300w meanwell.

Do you need any other info?

[dc42]

@paulhew, are you running with attached SBC, or in standalone mode?

[PaulHew]

@dc42 With a SBC. Pi4.
Regards, Paul.