mid print stall RRF 3.4B2

Nuramori

After retrying to print, it happened again, this time very early in the print, at a completely different place. Here's the results of a M122 for both the toolboard and the main board.

Main board, M122------

8/23/2021, 3:39:02 PM	M122
=== Diagnostics ===
RepRapFirmware for Duet 3 MB6HC version 3.4.0beta2 (2021-08-03 12:42:33) running on Duet 3 MB6HC v0.6 or 1.0 (SBC mode)
Board ID: 08DJM-956L2-G43S4-6J1F2-3SJ6T-1A6QH
Used output buffers: 1 of 40 (11 max)
=== RTOS ===
Static ram: 151128
Dynamic ram: 62380 of which 44 recycled
Never used RAM 116768, free system stack 138 words
Tasks: SBC(resourceWait:,2.1%,326) HEAT(delaying,0.1%,326) Move(notifyWait,0.3%,250) CanReceiv(notifyWait,0.0%,773) CanSender(notifyWait,0.0%,365) CanClock(delaying,0.0%,340) TMC(notifyWait,31.3%,59) MAIN(running,65.7%,922) IDLE(ready,0.4%,29), total 100.0%
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 04:29:15 ago, cause: software
Last software reset at 2021-08-23 16:17, reason: User, none spinning, available RAM 120220, slot 1
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x00400000 BFAR 0x00000000 SP 0x00000000 Task SBC Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Step timer max interval 157
MCU temperature: min 37.6, current 44.9, max 45.1
Supply voltage: min 23.1, current 23.3, max 23.4, under voltage events: 0, over voltage events: 0, power good: yes
12V rail voltage: min 12.0, current 12.0, max 12.1, under voltage events: 0
Heap OK, handles allocated/used 99/1, heap memory allocated/used/recyclable 2048/26/0, gc cycles 0
Driver 0: position 89208, standstill, reads 36346, writes 17 timeouts 0, SG min/max 0/1023
Driver 1: position 22120, standstill, reads 36347, writes 17 timeouts 0, SG min/max 0/1023
Driver 2: position 504, standstill, reads 36347, writes 17 timeouts 0, SG min/max 0/1007
Driver 3: position 0, standstill, reads 36347, writes 17 timeouts 0, SG min/max 0/1023
Driver 4: position 0, standstill, reads 36347, writes 17 timeouts 0, SG min/max 0/1023
Driver 5: position 0, standstill, reads 36353, writes 11 timeouts 0, SG min/max 0/0
Date/time: 2021-08-23 20:46:16
Slowest loop: 82.42ms; fastest: 0.03ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 37.5MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 125, segments created 49, maxWait 23148ms, bed compensation in use: mesh, comp offset 0.000
=== MainDDARing ===
Scheduled moves 8823, completed moves 8823, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 3], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1, chamberHeaters = -1 -1 -1 -1
Heater 0 is on, I-accum = 0.0
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 1
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File* is doing "G1 X236.921005 Y209.658997 E2507.777100" in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue* is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty
=== CAN ===
Messages queued 154786, received 195093, lost 0, longest wait 2ms for reply type 6031, peak Tx sync delay 261, free buffers 49 (min 40), ts 80780/80779/0
Tx timeouts 0,0,0,0,0,0
=== SBC interface ===
State: 4, failed transfers: 0, checksum errors: 0
Last transfer: 2ms ago
RX/TX seq numbers: 36692/36692
SPI underruns 0, overruns 0
Disconnects: 0, timeouts: 0, IAP RAM available 0x2c690
Buffer RX/TX: 2256/3728-0
=== Duet Control Server ===
Duet Control Server v3.4-b2
File:
Buffered code: G1 X236.921 Y209.659 E2507.77701
Buffered code: G1 X237.609 Y209.508 E2507.80371
Buffered code: G1 X278.035 Y169.082 E2509.97144
Buffered code: G1 X278.028 Y169.113 E2509.97264
Buffered code: G1 X277.859 Y169.795 E2509.99929
Buffered code: G1 X238.308 Y209.346 E2512.12009
Buffered code: G1 X239.031 Y209.161 E2512.14839
Buffered code: G1 X277.682 Y170.509 E2514.22097
Buffered code: G1 X277.548 Y171.054 E2514.24225
Buffered code: G1 X277.496 Y171.232 E2514.24928
Buffered code: G1 X239.753 Y208.976 E2516.27316
Buffered code: G1 X239.9 Y208.938 E2516.27892
Buffered code: G1 X240.506 Y208.76 E2516.30287
Buffered code: G1 X277.282 Y171.985 E2518.27485
Buffered code: G1 X277.067 Y172.734 E2518.30439
Buffered code: G0 F7200 X277.066 Y172.738
Buffered code: G1 F1620 X241.266 Y208.537 E2520.22404
Buffered code: G1 X241.629 Y208.431 E2520.23838
Buffered code: G1 X241.71 Y208.405 E2520.2416
Buffered code: G1 X242.049 Y208.293 E2520.25514
Buffered code: G1 X276.811 Y173.531 E2522.11915
Buffered code: G1 X276.555 Y174.323 E2522.15071
Buffered code: G1 X242.853 Y208.025 E2523.95788
Buffered code: G1 X243.514 Y207.805 E2523.9843
Buffered code: G1 X243.666 Y207.75 E2523.99043
Buffered code: G1 X276.263 Y175.153 E2525.73835
Buffered code: G1 X275.956 Y175.997 E2525.7724
Buffered code: G1 X244.52 Y207.434 E2527.45809
Buffered code: G1 X245.238 Y207.168 E2527.48712
Buffered code: G1 X245.382 Y207.109 E2527.49302
Buffered code: G1 X275.613 Y176.878 E2529.11407
==> 1496 bytes
Pending code: G1 X275.252 Y177.776 E2529.15077
Code buffer space: 2088
Configured SPI speed: 8000000Hz
Full transfers per second: 38.78, max wait times: 62.6ms/16.8ms
Codes per second: 0.68
Maximum length of RX/TX data transfers: 3244/1640
File /opt/dsf/sd/gcodes/BLVMGNC300_Spool Holder Frame.gcode is selected, processing

And the results of a M122 B20 for the toolboard -----

8/23/2021, 3:39:43 PM	M122 B20
Diagnostics for board 20:
Duet TOOL1LC firmware version 3.4.0beta2 (2021-08-03 10:00:09)
Bootloader ID: SAMC21 bootloader version 2.3 (2021-01-26b1)
Never used RAM 2680, free system stack 2745 words
Tasks: Move(notifyWait,0.1%,99) HEAT(delaying,0.8%,101) CanAsync(notifyWait,0.0%,57) CanRecv(notifyWait,0.1%,74) CanClock(notifyWait,0.1%,65) ACCEL(notifyWait,0.0%,61) TMC(notifyWait,9.2%,57) MAIN(running,73.8%,350) IDLE(ready,0.0%,27) AIN(delaying,16.0%,142), total 100.0%
Last reset 04:35:49 ago, cause: power up
Last software reset at 2021-08-23 15:12, reason: WatchdogTimeout, available RAM 2680, slot 0
Software reset code 0x00a0 ICSR 0x14413011 SP 0x20007f28 Task MAIN Freestk 5938 ok
Stack: 00000000 41000000 00000015 00000000 41000000 0000a78d 00016a4c 01000013 a5a5a5a5 00000000 20003324 20003360 20003364 fffffffd a29e9d69 00000000 00000002 00000000 00000002 00019477 00000000 2000213c 200020e0 20002088 00022640 200020e0 2000213c
Driver 0: position 3285835, 1299.0 steps/mm, standstill, SG min/max 0/112, read errors 2, write errors 0, ifcnt 16, reads 15462, writes 16, timeouts 0, DMA errors 0, steps req 3403427 done 3403427
Moves scheduled 8410, completed 8410, in progress 0, hiccups 0, step errors 0, maxPrep 715, maxOverdue 0, maxInc 0, mcErrs 0, gcmErrs 0
Peak sync jitter 5/10, peak Rx sync delay 621, resyncs 0/1, no step interrupt scheduled
VIN: 23.5V
MCU temperature: min 27.9C, current 57.0C, max 61.3C
Ticks since heat task active 84, ADC conversions started 16541384, completed 16541381, timed out 2, errs 0
Last sensors broadcast 0x00000002 found 1 89 ticks ago, loop time 0
CAN messages queued 199893, send timeouts 0, received 158561, lost 0, free buffers 37, min 35, error reg 110000
dup 0, oos 0/0/0/0, bm 0, wbm 0, rxMotionDelay 648, adv 35218/74656
Accelerometer detected: yes, status: 00
I2C bus errors 0, naks 3, other errors 0

Phaedrux

Can you post the gcode file in question as well as your config.g?

Nuramori

@phaedrux

Here's the config.g

; Configuration file for Duet3 (firmware version 3.4 Beta2)
; executed by the firmware on start-up
; 
; --------------- Pin/connection Mapping Legend -------------------
; 0.out0      - Bed heater
; 0.out1
; 0.out2
; 0.out3
; 0.out4      - Radiator cooling fan - WC heatsink
; 0.out5
; 0.out6
; 0.out7
; 0.out8
; 0.out9      - Duet board cooling fan
; 0.out4.tach - Radiator cooling fan rpm wire - WC heatsink
; 0.out5.tach
; 0.out6.tach
; 0.io0.in
; 0.io1.in    - Emergency stop switch
; 0.io2.in    - Y max active low endstop switch
; 0.io3.in
; 0.io4.in
; 0.io5.in
; 0.io6.in
; 0.io7.in
; 0.io8.in
; 0.io0.out
; 0.io1.out
; 0.io2.out
; 0.io3.out
; 0.io4.out
; 0.io5.out
; 0.io6.out
; 0.io7.out
; 0.io8.out
; 0.servo, out10 (only on v0.5, not on v0.6)
; 0.pson
; 0.spi.cs0
; 0.spi.cs1
; 0.spi.cs2
; 0.spi.cs3
; 0.temp0      - Bed Thermistor
; 0.temp1
; 0.temp2
; 0.temp3      - Coolant Temp Sensor
; 0.mcu-temp   - MCU sensor
;
;----------Toolboard 1 (CAN ID#20)
; 20.0         - Accelerometer
; 20.out0      - Hotend Heater
; 20.out1      -
; 20.out2      - Parts cooler on printhead
; 20.out1.tach -
; 20.out2.tach -
; 20.io0.in    - Z probe type to bltouch current - Piezo future
; 20.io1.in    - X min active low endstop switch
; 20.io2.in    -
; 20.io3.in    -
; 20.io0.out   - GPIO port 0 on toolboard io0, servo mode - BLTouch Z-Probe
; 20.temp0     - Extruder Thermistor
; 20.temp1     -
; 20.button0   -
; 20.button1   -
;
; -----------------------------------------------------------------
;
; General preferences
M81                               ; Turn on the Power (inverted for Meanwell)
G4 P2000                          ; Hold your Horses.
G90                               ; send absolute coordinates...
M83                               ; ...but relative extruder moves
G21                               ; Set units to Millimeters
M550 P"DUET3"                     ; set printer name
M575 P1 S1 B57600                 ; Set things up for the PanelDue

G4 S6                             ; Wait for toolboard to start
M584 X0.3 Y0.2 Z0.0:0.1:0.4 E20.0 ; set drive mapping to each axis
M669 K1                           ; Select CoreXY mode - New format

; Network
; M552 S1                         ; enable network
; M586 P0 S1                      ; enable HTTP
; M586 P1 S0                      ; disable FTP
; M586 P2 S0                      ; disable Telnet

; Drives
M569 P0.0 S0                    ; physical drive 0 goes backwards - Z Axis Left (1)
M569 P0.1 S0                    ; physical drive 1 goes backwards - Z Axis Right Back (2)
M569 P0.2 S0                    ; physical drive 2 goes backwards - Y Axis, activate Stealthchop
M569 P0.3 S0                    ; physical drive 3 goes backwards - X Axis, activate Stealthchop
M569 P0.4 S0                    ; physical drive 4 goes backwards - Z Axis Right Front (3)
M569 P20.0 S1                   ; physical drive 5 goes forwards - Extruder 1

; Set up three Z-axis location
M671 X-6:362:362 Y186:299:60 S5            ; Pivot Points at 1 - left, 2 - rear right and 3 - front right

M92 X200 Y200 Z800 E1299                  ; set steps per mm
M350 X16 Y16 Z16 E16 I1                    ; configure micro-stepping with interpolation
M566 X600.00 Y600.00 Z100.00 E240.00       ; set maximum instantaneous speed changes (mm/min)
M203 X16000.00 Y16000.00 Z400.00 E1200.00  ; set maximum speeds (mm/min)
M201 X4000.00 Y4000.00 Z400.00 E800.00     ; set accelerations (mm/s^2)
M906 X800 Y800 Z800 E800 I30               ; set motor currents (mA) and motor idle factor in percent*100

; Set up Stealthcop Parameters
; M569 P0.0 V40 H5
; M569 P0.1 V40 H5
; M569 P0.2 V40 H5
; M569 P0.3 V40 H5
; M569 P0.4 V40 H5
; M569 P20.0 V40 H5
; M915 X Y Z E T1

M84 S30                                    ; Set idle timeout

; Axis Limits
M208 X0 Y0 Z0 S1                           ; set axis minima
M208 X315 Y315 Z325 S0                     ; set axis maxima

; Endstops

M574 X1 S1 P"20.io1.in"                    ; X min active high endstop switch
M574 Y2 S1 P"0.io2.in"                     ; Y max active high endstop switch

; Z-Probe - BLTouch - *CURRENT*
M574 Z1 S2                                 ; set endstops controlled by probe
M558 P9 C"^20.io0.in" H5 F2000 T12000      ; set Z probe type to bltouch and the dive height + speeds (bltouch NEEDS pullup)
G31 P100 X0 Y-20 Z3.85                     ; set Z probe trigger value, offset and trigger height - 0.40MM NOZZLE FIXED Kv1
G30                                        ; Probe Z

; Configure Heaters and Sensors
M308 S0 P"0.temp0" Y"thermistor" A"Bed Heat" T100000 B3950    ; Configure bed temperature sensor
M950 H0 C"0.out0" T0                                          ; Define heater 0 (bed heater) - bed_heat pin and Temp Sensor 0 
M143 H0 S120 A2                                               ; set temperature limit for heater 0 to 120c
M140 H0                                                       ; Map heated bed to heater 0

M308 S1 P"20.temp0" Y"thermistor" A"Mosquito" T500000 B4723 C1.196220e-7  ; Configure extruder 1 temperature sensor - Mosquito
M950 H1 C"20.out0" T1                                                     ; Define heater 1 (hot-end E0) to use the "20.out0" pin and Temp Sensor 1

M143 H1 S270 A2                                               ; set temperature limit for heater 1 to 270C

M308 S2 P"mcu-temp" Y"mcu-temp" A"Duet Board"                 ; Configure MCU sensor
M308 S3 P"temp3" Y"thermistor" T10000 B3988 A"Coolant"        ; Configure coolant sensor

; Configure Fans
M950 F0 C"20.out2" Q100                 ; Define Fan_0 for use - Parts Cooler on Printhead - 5015 fan
M950 F1 C"0.out9" Q25000                ; Define Fan_1 for use - Duet board cooling fan
M950 F2 C"!0.out4+^0.out4.tach" Q25000  ; Define Fan_1 for use - Radiator cooling - WC heatsink. - PWM fan
M950 S0 C"20.io0.out"                   ; Define GPIO port 0 on IO0, servo mode - BLTouch Z-Probe - *CURRENT*
M950 J0 C"^!0.io1.in"                   ; Input 0 uses 0.io1.in pin, pullup enabled

; Fans
M106 P0 S0                          ; set fan 0. Parts Cooler on Printhead
M106 P1 T45:50 H2                   ; Set fan 1. Manages Duet board fan.
M106 P2 T20:40 H3                   ; Set fan 1. Manages Radiator fan for water-cooled loop.

;Set PID values             
M307 H0 B0 R0.720 C713.5 D2.13 S1.00               ; disable bang-bang mode for the bed heater and set PWM limit
M307 H1 B0 R2.487 C249.5:190.7 D5.51 S1.00 V23.1   ; disable bang-bang mode for the extruder heater and set PWM limit

; Pressure Advance
M572 D0 S0.05                             ; Set pressure advance to offset elasticity

; Dynamic Acceleration Adjustment and Non-linear
M592 D0 A0.015 B0.0012 L0.2
M593 P"ei3" F272 S0.1 L10

; Set Movement Queue
M595 P100

; Set up Accelerometer
M955 P20.0 I12                      ; Accelerometer on toolboard, oriented counter clockwise 90 Enable for RRF 3.3 Stable

; Tools
M563 P0 S"Printhead" D0 H1 F0       ; define tool 0. Fan 0 operates with an active hot-end
G10 L1 P0 X0 Y0 Z0                  ; set tool 0 axis offsets - - - X15 Y18 - Bed 0,0
G10 P0 R0 S0                        ; set active and standby temperatures to 0C

; Emergency Stop
M574 S1 P"^!0.io1.in"               ; Define Emergency endstop - emergency stop switch condition
M581 P0 S1 T0                       ; Define action to be taken with activation of emergency stop switch

; Miscellaneous
T0                                  ; select first tool

FIle is here....

Gcode in question

Nuramori

@phaedrux

I noticed this on the toolboard diagnostic. Is this indicative of anything?

"Last software reset at 2021-08-23 15:12, reason: WatchdogTimeout, available RAM 2680, slot 0"

dc42

@nuramori in RRF 3.4 beta 3 I fixed an issue that caused prints to stall in beta 2.

Nuramori

@dc42 thanks, good to know and I’ll install it ASAP. Any idea from what I posted above, if it was similar to the bug you found?

Nuramori

@dc42 unforunately, the issue was not resolved with the latest beta. I just had the same print I listed above, stall again, this time I could not pull any diagnostic, as the window said a reset was needed.

CadetC

@nuramori
What motors do you use for xy, ? I am surprised at the low current you have set for them. Another thing, and here I ask because I can not find any info on M915(stallguard) and T1 parameter - what is it for?

Nuramori

@cadetc I use Moons 0.9 1.5 amp NEMA17's they work great, looking at the torque curve charts and my setup.

The stealthchop stuff that's commented out are from when I was experimenting with it (if that's what you are referring to with the M915 command - it was to set the registers on the driver)

gloomyandy

@nuramori What "window" said that a reset was needed? It would be very useful to be able to see the output from M122 after a stall and before a reset. It may help to hook up a USB console and obtain the m122 from that after the stall.

Nuramori

@gloomyandy It was a dialog box stating that the machine had to be reset to continue - I didn't screenshot it, though I mentioned it in a previous post from me, with the exact wording. When that box comes up, there's no action possible, so I can't execute a M122 command to get data, and a restart wipes the ability to get the info related to the stall.

The original post contains M122 output from both the main board and the toolboard the one time I could perform a M122 command.

If it happens again, I'll try a USB connection to cull out info if possible.

gloomyandy

@nuramori I've tried to find your post with the details of the stalled dialog in it but failed. If you get chance it would probably help to see exactly what that wording was.

Nuramori

Im not sure if this is related, but ever since the following happened, things are now printing well.

After the mid print stalls, I had a temp sensor fault. The sensor itself was fine, so I performed an auto tune with the new beta. The result was notably different than the values I had before (which were generated with beta 2). Once I did that, I then was getting temp faults on the bed. I then auto tuned the bed and that too were notably different values.

Once I used the new values for the heaters, everything has been running perfectly fine. The same gcode has completed without a stall for multiple prints of the same file.