Capture failed with ZCU102 with FMC-MULTICAM4 using 19.2 version

I am working on MULTICAM4. I ported my design to 19.2 version from https://xterra2.avnet.com/xilinx/vitis_embedded_platform_source/zcu102/zcu102_mc4

I am unable to capture the video data. I am getting following error.

Setting pipeline to PAUSED ...

Using mplane plugin for capture

Using mplane plugin for capt[ 80.506534] random: gst-launch-1.0: uninitialized urandom read (16 bytes read)

ure

Using mplane plugin for capture

Pipeline is live and does not need PREROLL ...

/GstPipeline:pipeline0/GstV4l2Src:v4l2src3.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter3.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay1.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)2715733696, timestamp-offset=(uint)1239094422, seqnum-offset=(uint)12375, a-framerate=(string)30

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay3.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)212994530, timestamp-offset=(uint)1132231290, seqnum-offset=(uint)8638, a-framerate=(string)30

/GstPipeline:pipeline0/GstUDPSink:udpsink1.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)2715733696, timestamp-offset=(uint)1239094422, seqnum-offset=(uint)12375, a-framerate=(string)30

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay1.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter1.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstV4l2Src:v4l2src2.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter2.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay2.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)1225388770, timestamp-offset=(uint)207132082, seqnum-offset=(uint)25132, a-framerate=(string)30

libv4l2: error turning on stream: Broken pipe

/GstPipeline:pipeline0/GstUDPSink:udpsink2.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)1225388770, timestamp-offset=(uint)207132082, seqnum-offset=(uint)25132, a-framerate=(string)30

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay2.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter2.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstV4l2Src:v4l2src0.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:src: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay0.GstPad:src: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)1556797655, timestamp-offset=(uint)4111235936, seqnum-offset=(uint)22385, a-framerate=(string)30

/GstPipeline:pipeline0/GstUDPSink:udpsink0.GstPad:sink: caps = application/x-rtp, media=(string)video, clock-rate=(int)90000, encoding-name=(string)RAW, sampling=(string)BGR, depth=(string)8, width=(string)1920, height=(string)1080, colorimetry=(string)SMPTE240M, payload=(int)96, ssrc=(uint)1556797655, timestamp-offset=(uint)4111235936, seqnum-offset=(uint)22385, a-framerate=(string)30

/GstPipeline:pipeline0/GstRtpVRawPay:rtpvrawpay0.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

/GstPipeline:pipeline0/GstCapsFilter:capsfilter0.GstPad:sink: caps = video/x-raw, width=(int)1920, height=(int)1080, format=(string)BGR, framerate=(fraction)30/1, interlace-mode=(string)progressive, pixel-aspect-ratio=(fraction)1/1, colorimetry=(string)1:1:5:4

Setting pipeline to PLAYING ...

libv4l2: error turning on stream: Broken pipe

New clock: GstSystemClock

ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src2: Could not read from resource.

Additional debug info:

gstv4l2bufferpool.c(1058): gst_v4l2_buffer_pool_poll (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src2:

poll error 1: Broken pipe (32)

Execution ended after 0:00:00.000568917

Setting pipeline to PAUSED ...

Setting pipeline to READY ...

libv4l2: error turning on stream: Broken pipe

Setting pipeline to NULL ...

Freeing pipeline ..

From Kernel I am getting these errors while booting the board:

[ 3.911147] io scheduler kyber registered

[ 3.913703] xilinx-frmbuf b0020000.fb_wr: failed to get ap_clk (-517)

[ 3.913749] xilinx-frmbuf b1020000.fb_wr: failed to get ap_clk (-517)

[ 3.913792] xilinx-frmbuf b2020000.fb_wr: failed to get ap_clk (-517)

[ 3.913834] xilinx-frmbuf b3020000.fb_wr: failed to get ap_clk (-517)

[ 3.936687] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled

[ 3.956034] xilinx-video amba:vcap_gmsl: /amba/vcap_gmsl/ports/port@0 initialization failed

[ 3.956048] xilinx-video amba:vcap_gmsl: DMA initialization failed

[ 3.956172] xilinx-axis-switch amba:axis_switch@0: failed to get ap_clk (-517)

[ 3.956534] xilinx-csi2rxss a0060000.csiss: assuming all required clocks are enabled!

[ 3.956634] xilinx-csi2rxss a0060000.csiss: Xilinx CSI2 Rx Subsystem device found!

[ 3.958358] xilinx-vpss-scaler b0080000.scaler: xlnx,v-vpss-scaler-2.2 - compatible string is getting deprecated!

[ 3.958377] xilinx-vpss-scaler b0080000.scaler: failed to get aclk_axis (-517)

[ 3.958425] xilinx-vpss-scaler b1080000.scaler: xlnx,v-vpss-scaler-2.2 - compatible string is getting deprecated!

[ 3.958443] xilinx-vpss-scaler b1080000.scaler: failed to get aclk_axis (-517)

[ 3.958490] xilinx-vpss-scaler b2080000.scaler: xlnx,v-vpss-scaler-2.2 - compatible string is getting deprecated!

[ 3.958508] xilinx-vpss-scaler b2080000.scaler: failed to get aclk_axis (-517)

[ 3.958555] xilinx-vpss-scaler b3080000.scaler: xlnx,v-vpss-scaler-2.2 - compatible string is getting deprecated!

[ 3.958572] xilinx-vpss-scaler b3080000.scaler: failed to get aclk_axis (-517)

[ 3.958758] usbcore: registered new interface driver uvcvideo

Parents

0 albertabeef over 4 years ago

Pradeep,

You mentioned that you ported the zcu102_mc4 design.
Are you still on ZCU102 ? Are you still using version 2019.2 ? Please clarify.

You log indicates that you are using UDP/RTP sinks.
Can you clarify if the default passthrough script is working ?

Can you confirm if the video and media nodes are initializing correctly ?
What are you seeing for the following commands ?
$ ls /dev/video*
$ ls /dev/media*

Regards,
Mario..
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Reply

0 albertabeef over 4 years ago

Pradeep,

You mentioned that you ported the zcu102_mc4 design.
Are you still on ZCU102 ? Are you still using version 2019.2 ? Please clarify.

You log indicates that you are using UDP/RTP sinks.
Can you clarify if the default passthrough script is working ?

Can you confirm if the video and media nodes are initializing correctly ?
What are you seeing for the following commands ?
$ ls /dev/video*
$ ls /dev/media*

Regards,
Mario..
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel

Children

0 saipradeep523 over 4 years ago in reply to albertabeef

Hi Mario, Thanks for quick response.
Yes I am using ZCU102 only.
Yes I am using now 19.2 only. But my goal is to Multicam4 is on 20.1 version .
But 20.1 is not working same errors are getting for me.

So now I am experimenting 19.2 version (bit design) with Kernel version 5.4 (20.1 version).

all device files are populated, check below

zynqmp> ls /dev/video*
/dev/video0 /dev/video1 /dev/video2 /dev/video3
zynqmp> ls /dev/v4l-subdev*
/dev/v4l-subdev0   /dev/v4l-subdev13 /dev/v4l-subdev18 /dev/v4l-subdev6
/dev/v4l-subdev1   /dev/v4l-subdev14 /dev/v4l-subdev2   /dev/v4l-subdev7
/dev/v4l-subdev10 /dev/v4l-subdev15 /dev/v4l-subdev3   /dev/v4l-subdev8
/dev/v4l-subdev11 /dev/v4l-subdev16 /dev/v4l-subdev4   /dev/v4l-subdev9
/dev/v4l-subdev12 /dev/v4l-subdev17 /dev/v4l-subdev5
zynqmp> ls /dev/media0
/dev/media0

I have not verified with passthrough.

Do you have 19.2 prebuilt SD card images?

Xilinx has given for ZCU106 with Quad sensor but the underlying dts files are not given properly. But Avnet provided dts files for 18.3 and 19.2 are very clear.

Do you have working images or sources for 20.1 or 20.2 with ZCU102 and FMC multicam4?

In your kernel log have you got those type of -517 errors?
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 saipradeep523 over 4 years ago in reply to saipradeep523

Hi Mario,
I solved one error log:
[    3.913703] xilinx-frmbuf b0020000.fb_wr: failed to get ap_clk (-517)
[    3.913749] xilinx-frmbuf b1020000.fb_wr: failed to get ap_clk (-517)
[    3.913792] xilinx-frmbuf b2020000.fb_wr: failed to get ap_clk (-517)
[    3.913834] xilinx-frmbuf b3020000.fb_wr: failed to get ap_clk (-517)
[    3.936687] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled

Solutions: Framebuffer write IP Compatible string changed from "xlnx,axi-frmbuf-wr-v2.1" to "xlnx,axi-frmbuf-wr-v2" then these error are not comming. But Remaining errors are not solved.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 albertabeef over 4 years ago in reply to saipradeep523

Pradeep,

I do not have pre-built images of the ZCU102/ZCU104 designs for multi-cam.

For your scaler/VPSS core, what does your device tree content look like:

If you have something like this:
     compatible = "xlnx,v-vpss-scaler";
     ...
      clocks = <&axi_stream_clk>;

You will need to change this to:
     compatible = "xlnx,v-vpss-scaler-2.2";
     ...
     clock-names = "aclk_axis", "aclk_ctrl";
     clocks = <&axi_stream_clk>, <&axi_stream_clk>;

Regards,

Mario.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel
0 saipradeep523 over 4 years ago in reply to albertabeef
Hi Mario,

Scalar IP device tree is correct only,. My dts is blow same as to other pipeline scalar IPs

v_scaler_0: scaler@b0080000 {
                compatible = "xlnx,v-vpss-scaler-2.2";
                xlnx,num-hori-taps = <8>;
                xlnx,num-vert-taps = <8>;
                /*xlnx,max-num-phases = <64>;*/
                reg = <0x0 0xb0080000 0x0 0x40000>;
                clock-names = "aclk_axis", "aclk_ctrl";
                clocks = <&axi_stream_clk>, <&axi_stream_clk>;
                /*xlnx,max-lines = <2160>;*/
                /*xlnx,max-pixels = <3840>;*/
                xlnx,pix-per-clk = <1>;

                reset-gpios = <&gpio 82 1>;
                xlnx,max-height = <1080>;
                xlnx,max-width = <1920>;

                ports {
                        #address-cells = <1>;
                        #size-cells = <0>;

                        port@0 {
                                reg = <0>;

                                xlnx,video-format = <XVIP_VF_RBG>;
                                xlnx,video-width = <8>;

                              v_scaler_0_in: endpoint {
                                        /* remote-endpoint = <&demosaic_0_out>; */
                                        remote-endpoint = <&v_csc_0_out>;
                                };
                        };
                        port@1 {
                                reg = <1>;

                                xlnx,video-format = <XVIP_VF_YUV_422>;
                                xlnx,video-width = <8>;

                                v_scaler_0_out: endpoint {
                                        remote-endpoint = <&vcap_gmsl_in0>;
                                };
                        };
                };
        };

But i am not providing colorspace:srgb argument in my media-ctl settings. May be i will try by adding it. I think it may not solve my problem.
Cancel
Vote Up 0 Vote Down

Sign in to reply

Verify Answer

Cancel