ON Semiconductor Dual Camera Mezzanine Support

What sort of driver are you looking for?

Adam Taylor at Hackster.io has a pretty good example of building a Vivado project for the Ultra96 and the Dual Camera Mezzanine.

https://www.hackster.io/adam-taylor/avnet-ultra96-and-onsemi-dual-mipi-camera-3492ab

He does mentioning attempting moving to PYNQ with the Ultra96 and the Dual Camera Mezzanine, but I am not sure if he has completed this.

You might start here but I do not see anything specific with regards to the Dual Camera board though:

https://github.com/Avnet/Ultra96-PYNQ

Thanks for the reply!

I am new the Ultra96 and Xilinx, and was hoping to avoid using Vivado. It seems like there is a bit of a learning curve, and PYNQ is pretty user friendly and has everything I need on it aside from a driver for the Dual Cam Mezzanine board.

As far as what type of driver, I am looking for a Linux driver so I can access the camera from a python script - specifically using openCV

This interests me as well considering I am currently working on a RoadTest for the Ultra96 and the Dual Camera Mezzanine.

From what I can tell, there is little in the way of examples and such for the 96Boards ON Semiconductor Dual Camera Mezzanine and nothing I could find with regards to PYNQ.

There is this post on element14 with regards to building a PetaLinux image for the Ultra96 V2 and Dual Camera Mezzanine but nothing specific to OpenCV or PYNQ again:

https://www.element14.com/community/groups/fpga-group/blog/2021/01/14/ultra96-v2-dual-camera-mezzanine-petalinux-build-instructions

You could try to start with an example using the Ultra96-V2 and Python and see if you can add the Dual Camera Mezzanine instead of the USB camera.

Ex:

https://www.hackster.io/AlbertaBeef/face-detection-and-tracking-in-python-on-ultra96-v2-02d104

If I come up with something, I'll post it.

Cheers,

Jon

Hey everyone,

I just wanted to chime in so you knew I was working on this request. We currently don't have a stand alone driver, although we are working towards releasing one. That will be a while though so I'm trying to figure something else out. We haven't done any development with this platform using PYNQ so unfortunately I do not have any reference designs to share. I'll post back with anything I'm able to come up with ASAP.

Thanks
Chris

Thanks for the info, Chris.

For now, I want to just capture an image from the Mezzanine board using the petalinux image. I see there is some kind of driver available because the device registers under "/dev/media*" and "dev/video*", and the "run_1920_1080" script of course streams this video. Interestingly, any attempt to capture this image using openCV in python fails (it us successful with other basic UVC compliant webcams).

Am I meant to be able to do anything with the petalinux image that ships with the Mezzanine board aside from running the "run_1920_1080" program?

Thanks,

Chelsea

Chelsea,

What is the error that you are seeing when using OpenCV?

Looking at the "run_1920_1080" script, it appears it is setting up the two Cameras  via meida-ctl and then uses the /dev/video0 device to capture an image.  I wonder if you need to set-up the two cameras first before using them.

With regards to PYNQ support with the Ultra96 and the Dual Camera Mezz, perhaps the PYNQ Computer Vision code would be a place to start:

https://github.com/Xilinx/PYNQ-ComputerVision

https://github.com/Xilinx/PYNQ-ComputerVision/blob/master/overlays/README.md

This would require some work though considering the base branch is 2 years old..

Hi Jon,

I don't actually get an error, OpenCV just captures an empty image (filesize is 0).

I think you are right in that I am not setting something up correctly.

I had made a silly assumption that the "run_1920_1080" program was only available as a binary, as it was in the bin folder! Your posted prompted me to take a second look. I think this tells me enough on how to interact with the driver to move forward.

Thank you!