Actions
Forum Thread Details
  • Replies 2 replies
  • Subscribers 558 subscribers
  • Views 95 views
  • Users 0 members are here
Related

RAW Bayer Capture Request for Ultra96-V2 Dual Camera Mezzanine with AR0144 (2022.2)

ApoorvaPatil

Hello element14 community members,

I am using the Ultra96-V2 along with the Dual Camera Mezzanine, populated with the ON Semiconductor AR0144 sensor, and working with the 2022.2 toolchain.
The default dual-camera reference project works correctly, and we can capture greyscale frames.

However, for our project we need to capture RAW Bayer frames (RAW8/RAW10/RAW12) directly from the AR0144 sensor. This requires using the AP1302 in RAW passthrough mode, which is not enabled in the default example.

Could you please provide:

  • A RAW Bayer capture reference design (Vivado + PetaLinux) for AR0144
  • The appropriate AP1302 RAW sequencer firmware
  • Any guidance or documentation for enabling RAW sensor data streaming

Preferred configuration:

  • Sensor: AR0144
  • RAW Format: RAW8 or RAW10 or RAW12 Bayer
  • Tool version: 2022.2
  • Capture via v4l2-ctl or GStreamer

If earlier versions are available (e.g., 2020.1), instructions for porting to 2022.2 would be very helpful.

Thank you for your support.

Best regards,
Apoorva

Parents

  • Hi Apoorva,

    I’ve worked with RAW output pipelines before on similar setups, so I can share some direction. Unfortunately, the default Ultra96-V2 + Dual Camera Mezzanine examples only expose the AP1302 in processed/ISP mode, so RAW passthrough has to be manually enabled.

    Heavy check mark RAW Bayer Capture (AP1302 Passthrough)

    To get RAW8/RAW10/RAW12 from the AR0144, you must load AP1302 firmware that explicitly enables RAW passthrough mode. This is not present in the stock example, but ON Semiconductor provides reference sequencer files through their partner channels (you usually need an NDA or a support ticket with them).

    Heavy check mark What You’ll Need

    1. AP1302 RAW sequencer firmware

    2. A Vivado project where:

      • ISP blocks are disabled

      • The AP1302 output format is set to RAW Bayer

      • The MIPI-CSI2 receiver is configured for the exact RAW bit-depth

    3. PetaLinux device tree updates for:

      • pixel-format = “SRGGB8” or “SRGGB10”

      • correct CSI virtual channel

    4. A v4l2-ctl or GStreamer pipeline such as:

      v4l2-ctl --set-fmt-video=pixelformat=RG10 --stream-mmap --stream-count=100

    Heavy check mark Reference Designs

    If you don’t have access to AP1302 RAW firmware, you can request it from ON Semi support. They sometimes provide older versions (e.g., 2020.x), which you can port to 2022.2 — the porting mostly involves device-tree alignment and minor D-PHY updates.

    Heavy check mark Additional Note

    If you need to preprocess very low-level sensor signals (µV/mV range) before feeding them into your design or testing, this voltage amplifier module might help:
     Point right https://easyelecmodule.com/product/voltage-amplifier/

Reply Children
No Data