Duet Camera?
-
Just another item on my wishlist - it’d be great to incorporate a duet camera (or just software) into the ecosystem (CAN-bus ir POE?). Easier camera integration into the UI - and the long shot feature for me, but AI print monitoring. Should be feasible to detect common issues such as print pulling off the bed. Maybe provide a cloud service that would analyze the images every minute or so to look for errors?
Anyway, just a few ideas.
-
@TLAS there’s https://docs.duet3d.com/en/User_manual/Reference/DWC_webcam
And the Spaghetti detective does the AI monitoring part.Ian
-
@droftarts
But is it possible to run "obico" with a duet in standalone? As in somewhat "out of box" -
@Exerqtor sorry, no idea.
Edit: it’s an octoprint plugin, so could potentially be written to work with Duet and SBC (unlikely to ever work in standalone), on DSF/DWC with a plugin. Alternatively, you could run Duet on Octoprint and use it.
Ian
-
@Exerqtor I don’t know how the spaghetti detective works, but would think that there’s a more general way to do this, locally, for free. With a fixed point camera, a DWC plugin could generate a view of what the print ‘should’ look like, then use something like OpenCV to compare that with the image from the camera. Maybe @Sindarius gcode viewer could generate the ‘view from a definable camera position’? And there’s probably some free image comparison sites.
Ian
-
@droftarts said in Duet Camera?:
@Exerqtor sorry, no idea.
Edit: it’s an octoprint plugin, so could potentially be written to work with Duet and SBC (unlikely to ever work in standalone), on DSF/DWC with a plugin. Alternatively, you could run Duet on Octoprint and use it.
Ian
Yeah that's what I thought/understood to, just wanted to make sure I hadn't missed out on something
😅
@droftarts said in Duet Camera?:
@Exerqtor I don’t know how the spaghetti detective works, but would think that there’s a more general way to do this, locally, for free. With a fixed point camera, a DWC plugin could generate a view of what the print ‘should’ look like, then use something like OpenCV to compare that with the image from the camera. Maybe @Sindarius gcode viewer could generate the ‘view from a definable camera position’? And there’s probably some free image comparison sites.
Ian
That's an interesting idea, would something like a Duet 3 Mini5 have enough power under the hood to pull that of though?
I guess if it "just" used a still picture of how the (out lined shape or something) based on the gcode viewer and compared it to a cam image ran thru the same filter to each other it wouldn't be THAT compute heavy
-
@Exerqtor it would run in the browser. The Gcode viewer could perhaps output an image of the current layer with edge highlighting, matching the webcam view. The webcam view on layer change (with nozzle moves out of the way) could have an edge filter applied, and OpenCV could compare the images. I reckon something like that could work.
Ian
-
No idea if the hardware allows for it, but I would very much be in favor of some quality camera module than can interface with the Duet 3s in standalone mode, even if the update rate might be severly limited to like 1fps or so.
It would be nice to see this in a well-integrated package, space efficient so that it can be easily integrated in tight corners of the printer etc, maybe include a thermistor for measuring chamber temp?
Maybe via CAN even?