Keep getting random crashes.

Nuramori

This will happen with no known cause; the printer will suddenly stop printing, usually after a print that's at least 5 hours long, and come up with a message that the machine has to restart. There's no way to do anything until I agree to the reset, but immediately after the last one I did a M122 and a M122 B20 to also pull info from the toolboard. I am on RRF 3.3RC3 with a Duet 3 v1.0 and a v1.1 toolboard.

These are the messages from the query. I'm not sure if it manages to catch a cause for the crash.

M122M122 B20
Diagnostics for board 20:
Duet TOOL1LC firmware version 3.3RC3 (2021-05-26 12:30:20)
Bootloader ID: SAMC21 bootloader version 2.3 (2021-01-26b1)
Never used RAM 2692, free system stack 2788 words
Tasks: Move(notifyWait,0.0%,153) HEAT(delaying,0.1%,115) CanAsync(notifyWait,0.0%,65) CanRecv(notifyWait,0.0%,79) CanClock(notifyWait,0.0%,66) ACCEL(notifyWait,0.0%,61) TMC(notifyWait,2.8%,57) MAIN(running,92.1%,343) IDLE(ready,0.0%,26) AIN(delaying,4.9%,142), total 100.0%
Last reset 00:01:07 ago, cause: software
Last software reset time unknown, reason: AssertionFailed, available RAM 3612, slot 2
Software reset code 0x0120 ICSR 0x00000000 SP 0x2000407c Task   Freestk 130 bad marker
Stack: 00000544 00023174 00019cb5 20003044 00016e33 20003044 00016505 20000ed0 00000000 00000001 0000828d 200071c8 200071c8 200071e0 00000000 20000f50 000116b3 00022530 000225e8 00021c40 00019c55 200071c8 200071c8 20000f50 00008405 200071d8 000009c7
Driver 0: position 0, 1299.0 steps/mm, standstill, SG min/max 2/2, read errors 0, write errors 1, ifcnt 30, reads 33801, writes 12, timeouts 0, DMA errors 0, steps req 0 done 0
Moves scheduled 0, completed 0, in progress 0, hiccups 0, step errors 0, maxPrep 0, maxOverdue 0, maxInc 0, mcErrs 0, gcmErrs 0
Peak sync jitter 0/9, peak Rx sync delay 193, resyncs 0/0, no step interrupt scheduled
VIN: 23.5V
MCU temperature: min 51.0C, current 51.0C, max 55.8C
Ticks since heat task active 160, ADC conversions started 67654, completed 67653, timed out 0, errs 0
Last sensors broadcast 0x00000002 found 1 165 ticks ago, loop time 0
CAN messages queued 375, send timeouts 23, received 344, lost 0, free buffers 37, min 37, error reg 110000
Last cancelled message type 4512 dest 127
dup 0, oos 0/0/0/0, bm 0, wbm 0
Accelerometer detected: yes, status: 00
I2C bus errors 0, naks 0, other errors 0
6/13/2021, 9:03:35 PM	M122
=== Diagnostics ===
RepRapFirmware for Duet 3 MB6HC version 3.3RC3 (2021-05-26 12:29:42) running on Duet 3 MB6HC v0.6 or 1.0 (SBC mode)
Board ID: 08DJM-956L2-G43S4-6J1F2-3SJ6T-1A6QH
Used output buffers: 1 of 40 (10 max)
=== RTOS ===
Static ram: 150784
Dynamic ram: 61776 of which 484 recycled
Never used RAM 125148, free system stack 190 words
Tasks: SBC(ready,6.5%,336) HEAT(delaying,0.0%,321) Move(notifyWait,0.0%,302) CanReceiv(notifyWait,0.0%,798) CanSender(notifyWait,0.0%,374) CanClock(delaying,0.0%,339) TMC(notifyWait,7.6%,93) MAIN(running,85.6%,922) IDLE(ready,0.3%,29), total 100.0%
Owned mutexes: HTTP(MAIN)
=== Platform ===
Last reset 00:00:38 ago, cause: software
Last software reset at 2021-06-14 02:06, reason: User, none spinning, available RAM 122076, slot 1
Software reset code 0x0012 HFSR 0x00000000 CFSR 0x00000000 ICSR 0x0044a000 BFAR 0x00000000 SP 0x00000000 Task SBC Freestk 0 n/a
Error status: 0x00
Aux0 errors 0,0,0
Aux1 errors 0,0,0
Step timer max interval 126
MCU temperature: min 38.8, current 39.7, max 40.0
Supply voltage: min 23.2, current 23.3, max 23.3, under voltage events: 0, over voltage events: 0, power good: yes
12V rail voltage: min 12.0, current 12.0, max 12.1, under voltage events: 0
Heap OK, handles allocated/used 0/0, heap memory allocated/used/recyclable 0/0/0, gc cycles 0
Driver 0: position 0, standstill, reads 18048, writes 14 timeouts 0, SG min/max 0/0
Driver 1: position 0, standstill, reads 18048, writes 14 timeouts 0, SG min/max 0/0
Driver 2: position 0, standstill, reads 18048, writes 14 timeouts 0, SG min/max 0/0
Driver 3: position 0, standstill, reads 18048, writes 14 timeouts 0, SG min/max 0/0
Driver 4: position 0, standstill, reads 18048, writes 14 timeouts 0, SG min/max 0/0
Driver 5: position 0, standstill, reads 18051, writes 11 timeouts 0, SG min/max 0/0
Date/time: 2021-06-14 02:07:28
Slowest loop: 0.45ms; fastest: 0.05ms
=== Storage ===
Free file entries: 10
SD card 0 not detected, interface speed: 37.5MBytes/sec
SD card longest read time 0.0ms, write time 0.0ms, max retries 0
=== Move ===
DMs created 125, maxWait 0ms, bed compensation in use: none, comp offset 0.000
=== MainDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== AuxDDARing ===
Scheduled moves 0, completed moves 0, hiccups 0, stepErrors 0, LaErrors 0, Underruns [0, 0, 0], CDDA state -1
=== Heat ===
Bed heaters = 0 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1 -1, chamberHeaters = -1 -1 -1 -1
Heater 1 is on, I-accum = 0.0
=== GCodes ===
Segments left: 0
Movement lock held by null
HTTP* is doing "M122" in state(s) 0
Telnet is idle in state(s) 0
File is idle in state(s) 0
USB is idle in state(s) 0
Aux is idle in state(s) 0
Trigger* is idle in state(s) 0
Queue is idle in state(s) 0
LCD is idle in state(s) 0
SBC is idle in state(s) 0
Daemon is idle in state(s) 0
Aux2 is idle in state(s) 0
Autopause is idle in state(s) 0
Code queue is empty.
=== CAN ===
Messages queued 306, send timeouts 0, received 282, lost 0, longest wait 2ms for reply type 6049, peak Tx sync delay 193, free buffers 49 (min 48), ts 193/192/0
=== SBC interface ===
State: 4, failed transfers: 0
Last transfer: 1ms ago
RX/TX seq numbers: 1105/1105
SPI underruns 0, overruns 0
Number of disconnects: 0, IAP RAM available 0x2c88c
Buffer RX/TX: 0/0-0
=== Duet Control Server ===
Duet Control Server v3.3-rc3
Code buffer space: 4096
Configured SPI speed: 8000000 Hz
Full transfers per second: 35.26
Codes per second: 2.07
Maximum length of RX/TX data transfers: 2804/488

Phaedrux

Can you post your config.g and a M122 of the mainboard as well?

droftarts

@phaedrux it’s there, from line 23. Looks blank to me. @dc42 can you take a look?

Ian

dc42

@nuramori I think this is already fixed in the build at https://www.dropbox.com/sh/xfsvscbaab0dtzl/AACCcSeiTNINZL-xbs6IhC4Ja?dl=0.

Nuramori

@phaedrux The top portion is the toolboard M122, and starting at line 23 is the M122 for the mainboard.

My config.g file is as follows:

; Configuration file for Duet3 (firmware version 3.3 RC1+1)
; executed by the firmware on start-up
; 
; --------------- Pin/connection Mapping Legend -------------------
; 0.out0      - Bed heater
; 0.out1
; 0.out2
; 0.out3
; 0.out4      - Radiator cooling fan - WC heatsink
; 0.out5
; 0.out6
; 0.out7
; 0.out8
; 0.out9      - Duet board cooling fan
; 0.out4.tach - Radiator cooling fan rpm wire - WC heatsink
; 0.out5.tach
; 0.out6.tach
; 0.io0.in
; 0.io1.in    - Emergency stop switch
; 0.io2.in    - Y max active low endstop switch
; 0.io3.in
; 0.io4.in
; 0.io5.in
; 0.io6.in
; 0.io7.in
; 0.io8.in
; 0.io0.out
; 0.io1.out
; 0.io2.out
; 0.io3.out
; 0.io4.out
; 0.io5.out
; 0.io6.out
; 0.io7.out
; 0.io8.out
; 0.servo, out10 (only on v0.5, not on v0.6)
; 0.pson
; 0.spi.cs0
; 0.spi.cs1
; 0.spi.cs2
; 0.spi.cs3
; 0.temp0      - Bed Thermistor
; 0.temp1
; 0.temp2
; 0.temp3      - Coolant Temp Sensor
; 0.mcu-temp   - MCU sensor
;
;----------Toolboard 1 (CAN ID#20)
; 20.0         - Accelerometer
; 20.out0      - Hotend Heater
; 20.out1      -
; 20.out2      - Parts cooler on printhead
; 20.out1.tach -
; 20.out2.tach -
; 20.io0.in    - Z probe type to bltouch current - Piezo future
; 20.io1.in    - X min active low endstop switch
; 20.io2.in    -
; 20.io3.in    -
; 20.io0.out   - GPIO port 0 on toolboard io0, servo mode - BLTouch Z-Probe
; 20.temp0     - Extruder Thermistor
; 20.temp1     -
; 20.button0   -
; 20.button1   -
;
; -----------------------------------------------------------------
;
; General preferences
M81                               ; Turn on the Power (inverted for Meanwell)
G4 P2000                          ; Hold your Horses.
G90                               ; send absolute coordinates...
M83                               ; ...but relative extruder moves
G21                               ; Set units to Millimeters
M550 P"DUET3"                     ; set printer name
M575 P1 S1 B57600                 ; Set things up for the PanelDue

G4 S6                             ; Wait for toolboard to start
M584 X0.3 Y0.2 Z0.0:0.1:0.4 E20.0 ; set drive mapping to each axis
M669 K1                           ; Select CoreXY mode - New format

; Network
; M552 S1                         ; enable network
; M586 P0 S1                      ; enable HTTP
; M586 P1 S0                      ; disable FTP
; M586 P2 S0                      ; disable Telnet

; Drives
M569 P0.0 S0                    ; physical drive 0 goes backwards - Z Axis Left (1)
M569 P0.1 S0                    ; physical drive 1 goes backwards - Z Axis Right Back (2)
M569 P0.2 S0                    ; physical drive 2 goes backwards - Y Axis, activate Stealthchop
M569 P0.3 S0                    ; physical drive 3 goes backwards - X Axis, activate Stealthchop
M569 P0.4 S0                    ; physical drive 4 goes backwards - Z Axis Right Front (3)
M569 P20.0 S1                   ; physical drive 5 goes forwards - Extruder 1

; Set up three Z-axis location
M671 X-6:362:362 Y186:299:60 S5            ; Pivot Points at 1 - left, 2 - rear right and 3 - front right

M92 X199 Y198 Z1585 E1299                  ; set steps per mm
M350 X16 Y16 Z16 E16 I1                    ; configure micro-stepping with interpolation
M566 X600.00 Y600.00 Z100.00 E240.00       ; set maximum instantaneous speed changes (mm/min)
M203 X16000.00 Y16000.00 Z400.00 E1200.00  ; set maximum speeds (mm/min)
M201 X4000.00 Y4000.00 Z400.00 E800.00     ; set accelerations (mm/s^2)
M906 X800 Y800 Z800 E800 I30               ; set motor currents (mA) and motor idle factor in percent*100

; Set up Stealthcop Parameters
; M569 P0.0 V40 H5
; M569 P0.1 V40 H5
; M569 P0.2 V40 H5
; M569 P0.3 V40 H5
; M569 P0.4 V40 H5
; M569 P20.0 V40 H5
; M915 X Y Z E T1

M84 S30                                    ; Set idle timeout

; Axis Limits
M208 X0 Y0 Z0 S1                           ; set axis minima
M208 X315 Y315 Z325 S0                     ; set axis maxima

; Endstops

M574 X1 S1 P"20.io1.in"                    ; X min active high endstop switch
M574 Y2 S1 P"0.io2.in"                     ; Y max active high endstop switch

; Z-Probe - BLTouch - *CURRENT*
M574 Z1 S2                                 ; set endstops controlled by probe
M558 P9 C"^20.io0.in" H5 F2000 T12000      ; set Z probe type to bltouch and the dive height + speeds (bltouch NEEDS pullup)
G31 P100 X0 Y-20 Z3.85                     ; set Z probe trigger value, offset and trigger height - 0.40MM NOZZLE FIXED Kv1
G30                                        ; Probe Z

; Configure Heaters and Sensors
M308 S0 P"0.temp0" Y"thermistor" A"Bed Heat" T100000 B3950    ; Configure bed temperature sensor
M950 H0 C"0.out0" T0                                          ; Define heater 0 (bed heater) - bed_heat pin and Temp Sensor 0 
M143 H0 S120 A2                                               ; set temperature limit for heater 0 to 120c
M140 H0                                                       ; Map heated bed to heater 0

M308 S1 P"20.temp0" Y"thermistor" A"Mosquito" T500000 B4723 C1.196220e-7  ; Configure extruder 1 temperature sensor - Mosquito
M950 H1 C"20.out0" T1                                                     ; Define heater 1 (hot-end E0) to use the "20.out0" pin and Temp Sensor 1

M143 H1 S270 A2                                               ; set temperature limit for heater 1 to 270C

M308 S2 P"mcu-temp" Y"mcu-temp" A"Duet Board"                 ; Configure MCU sensor
M308 S3 P"temp3" Y"thermistor" T10000 B3988 A"Coolant"        ; Configure coolant sensor

; Configure Fans
M950 F0 C"20.out2" Q100                 ; Define Fan_0 for use - Parts Cooler on Printhead - 5015 fan
M950 F1 C"0.out9" Q25000                ; Define Fan_1 for use - Duet board cooling fan
M950 F2 C"!0.out4+^0.out4.tach" Q25000  ; Define Fan_1 for use - Radiator cooling - WC heatsink. - PWM fan
M950 S0 C"20.io0.out"                   ; Define GPIO port 0 on IO0, servo mode - BLTouch Z-Probe - *CURRENT*
M950 J0 C"^!0.io1.in"                   ; Input 0 uses 0.io1.in pin, pullup enabled

; Fans
M106 P0 S0                          ; set fan 0. Parts Cooler on Printhead
M106 P1 T45:50 H2                   ; Set fan 1. Manages Duet board fan.
M106 P2 T20:40 H3                   ; Set fan 1. Manages Radiator fan for water-cooled loop.

;Set PID values             
M307 H0 B0 R0.720 C713.5 D2.13 S1.00               ; disable bang-bang mode for the bed heater and set PWM limit
M307 H1 B0 R2.487 C249.5:190.7 D5.51 S1.00 V23.1   ; disable bang-bang mode for the extruder heater and set PWM limit

; Pressure Advance
M572 D0 S0.05                             ; Set pressure advance to offset elasticity

; Dynamic Acceleration Adjustment and Non-linear
M592 D0 A0.015 B0.0012 L0.2
M593 F21 P4

; Set Movement Queue
M595 P100

; Set up Accelerometer
M955 P20.0 I12                      ; Accelerometer on toolboard, oriented counter clockwise 90 Enable for RRF 3.3 Stable

; Tools
M563 P0 S"Printhead" D0 H1 F0       ; define tool 0. Fan 0 operates with an active hot-end
G10 L1 P0 X0 Y0 Z0                  ; set tool 0 axis offsets - - - X15 Y18 - Bed 0,0
G10 P0 R0 S0                        ; set active and standby temperatures to 0C

; Emergency Stop
M574 S1 P"^!0.io1.in"               ; Define Emergency endstop - emergency stop switch condition
M581 P0 S1 T0                       ; Define action to be taken with activation of emergency stop switch

; Miscellaneous
T0                                  ; select first tool

Nuramori

@dc42 Thanks, I'll try them... I'm not sure what to do with the *.map files - do they also get uploaded to the /system folder?

jay_s_uk

@nuramori map files aren't needed by you. they are for dc42's use

Nuramori

@jay_s_uk Thanks for the info! This occurrence has happened a few times, so I hope this will tackle the issue. It's not something I can easily replicate, other than running a long print.

dc42

@nuramori said in Keep getting random crashes.:

@dc42 Thanks, I'll try them... I'm not sure what to do with the *.map files - do they also get uploaded to the /system folder?

Ignore the .map files.

Phaedrux

@droftarts said in Keep getting random crashes.:

@phaedrux it’s there, from line 23.

Trip to the eye doctor for me I think.