Embedding PixyCam video in DWC?

o_lampe

Hi guys,
I have this PixyCam which can do color recognition and has means to trace eg. a pingpong ball.
I also have a bright red silicone sock on my heater block, I could teach to PixyCam.
I believe it would be a pretty good surveilance video, when the camera follows the hotend.
It came with a servo gimbal, but I'd like to replace these noisy jittering servos with brushless or steppers.
The programs are written for Arduino, so instead of sacrifying two stepperdrivers from Duet-EXP boards, I could digg out an old RAMPS.

Question is, how can I integrate the video into DWC and probably even have a jog function to adjust the camera gimbal?

My search for PixyCam didn't pop up any old threads, so this might be the first attempt to integrate such device.
Or are there other gimbal adjusted cams, which get their position data from Duet/RRF?

Phaedrux

@o_lampe said in Embedding PixyCam video in DWC?:

My search for PixyCam didn't pop up any old threads, so this might be the first attempt to integrate such device.
Or are there other gimbal adjusted cams, which get their position data from Duet/RRF?

First I've heard of it and I haven't seen anything similar.

What kind of a video stream does it output?

o_lampe

@Phaedrux really never heard of their Kickstarter campain? It went throught the roof and it got me interested in robotics, too,

(*)The video resolution can be 1280x800@60Hz, but in object follow-mode it's down to 640x400.
The pictures are a bit dull, because of the image processing parameters.
And it takes a dedicated USB-lib to grab a steady video stream, which makes it harder to implement it in DWC.

(*) all of the above information might be outdated and reflect the PixyCam1. There's a new PixyCam2 around, with other/better data or display options

Anyway, also for the Duet SBC portfolio it's an option to consider.

DIY-O-Sphere

@o_lampe
Please do not misunderstand, I also find this impressive, but I have not yet understood what this is supposed to accomplish on the 3D printer.

If you want to control the print result, this solution would be much better.
https://www.youtube.com/watch?v=MZROg5rd6AM

o_lampe

@DIY-O-Sphere
You are right, the video is amazing. Although I got a bit seasick...But the lag of a gimbal controlled camera will be worse, I guess.

I just want to make use of what I have laying around, since the lockdown will keep us grounded for a loooong time. ( other countries may vary)

...reminds me, I have an endoscope camera as well

Anyway, both options are a good alternative to a fix-mounted RasPi- or USB cam.

//edit There IS a Linux driver for PixyCam and Raspi can stream the data, as I've read.

DIY-O-Sphere

@o_lampe
I have installed a 2nd camera that looks flat across the bed at the nozzle. The resolution is 1920×1080. It covers the area for the prime line and the print area.
You can only see the nozzle well in the prime line area, where the lens is about 3cm away. In the print area, only rough errors can be noticed.

I will buy such a microscope camera.
I am currently rebuilding the air guide anyway.

o_lampe

@DIY-O-Sphere said in Embedding PixyCam video in DWC?:

I will buy such a microscope camera.

Make sure it has an IR-filter lens...mine hasn't