KV260 read mipi frame stuck on dma, help

[marioruiz]

Hi @cking,

Good to know that the camera is working now.

1. If you check this notebook Kria-PYNQ/kv260/base/notebooks/video/mipi_to_displayport.ipynb at main · Xilinx/Kria-PYNQ · GitHub you’ll see that we do a manipulation of the frame before printing to display.

2. You can do this rearrangement in hw using a AXI4 Stream Subset converter to swap the color channels.

I notice the frames extracted from the vdma are of the format, pynq.buffer.PynqBuffer described as a “subclass of array” does that mean it can be treated the same as a numpy array?

Yes, this is a numpy array that you can manipulate.

[cking]

Hi Mario,

Worked great, that was an easy fix. Thanks for the help along the way.

I’m still unsure what prevents the MIPI camera from being able to be used with the base overlay. If I need to use the camera within this PYNQ base design in the future I will look back into it and update the thread.

Cheers,
Cameron

[sergicuen]

Hi cking,
really good job.
I am facing similar issues in designing a custom overlay for 5C MIPI cam.
I wonder if you could share your “base overlay” that is working with the “cameron king notebook” above.
Thanks
Sergio

[cking]

Hi Sergicuen,

Apologies for being inactive over the last while.

Certainly, the following configuration is what I take as the working case:

Top level notebook:
1080p working.ipynb (14.1 KB)

That reaches out to run the following nb (hence keep in local directory alongside top level:
pcam_cfg.ipynb (26.2 KB)

And the working bitstream and hwh that make up my hardware design (modified Adam Taylor design).

taylor_v3.bit (7.4 MB)
taylor_v3.hwh (1.4 MB)

Hope this is still useful to you!
Regards,
Cameron

[sergicuen]

Hi @cking ,
thanks a lot.
In the mean time, I was working with the KV260 base overlay. I wrote a workaround to configure the V_Proc_sys and the PixelPacker IPs to get GRAY frames.
Here you can find the python code if you are interested.
Regards

[cking]

Hi @sergicuen,

Sounds interesting, would love to have a look at the code!

[juanppalacios]

Hi @sergicuen,

I was curious if you could also provide your implementation as I, too, am working with the KV260 board.

Thanks

[sergicuen]

Hi @juanppalacios ,
I used the original base overlay GitHub - mariodruiz/Kria-PYNQ , and some python code to reconfig the V_proc and Pixelpacker IP.
You can find the python code here:

Kria base overlay, mipi cam5c, how to change the ColorSpaceConversion?

Hi all, I am working on the Kria base overlay (mipi_to_display notebook). I am trying to store a gray image via VDMA (8bits/pixel, Y channel). Using the following code: videomode = VideoMode(1280, 720, 8) mipi.configure(videomode) frame = mipi.readframe() frame.shape # (720, 1280) I get a gray image but, looking at the pynq code I see that pixel data is just written with the B channel. The reason is that v_proc_sys IP is configure to bypass the BGR pixels coming from the demosaic/gamma pi…

In addition, in the following post you can find the workaround of a little bug in the overlay:

Kria base overlay BUG?

Hi all, my problem is related to Kria KV260 & Base overlay (GitHub - mariodruiz/Kria-PYNQ) & Vivado 2022.1. Taking a look at the MIPI of the base project, there is a Subset Converter to swap the channels. [Screenshot-21] Input (MSB to LSB): R1 B1 G1 | R0 B0 G0 the swap is defined as TDATA remap string: tdata[15:0], tdata[23:16], tdata[39:24], tdata[47:40] Output (MSB to LSB): B0 G0 R0 | B1 G1 R1 So, it produces a swap between channels but also beween pixels. This can be seen in the …

Regards

[sergicuen]

Hi @juanppalacios ,
see my previous reply