Taking over control of displayport output using live feed settings

Hi all,

Bringing this thread back to life again as I am trying to do the same thing by using this design provided by Adam Taylor and merge it with a previous design I have created. (see: here).

The aim of my design is to create a Video processing pipeline on the Kria KV260 (Zynq Ultrascale+ MPSoC) that can capture video from a MIPI camera (digilent PCam5C) and pass it through processing a PL pipeline that allows for low latency, purely FPGA based streaming - i.e. no storage of frames in DDR memory through the VDMA. To do this I aim to deviate from the MIPI processing line from the PYNQ baseline design (that writes frames to VDMA, then Reads them and pushes them to the displayport) and instead bypass the VDMA as shown below:

From looking into these mipi/displayport example notebooks provided as part of PYNQ baseline design, I can see the DisplayPort Controller Is configured via the pynq/lib/video/drm.py underlying file. But from what I can see this file is tailored for the base design hence - cannot be used for live PL → Displayport streaming .

Ideally I would like to keep my software configuration in the PYNQ world, as with my previous MIPI work I ended up writing the camera driver in Python ipynb form. However, Is it possible to configure the Displayport controller for Live PL streaming out of HDMI for the Zynq Ultrascale+ MPSoC from pynq?.

Concerns:

  1. Adam Taylor’s example describes using Vitis to modify the BSP - configuring the displayport component on arm_cortex_a53 to use the AVBUF driver - does this bind me to loading the hardware and software designs in the Vitis environment?

  2. I find it strange there are no examples for this work in a PYNQ environment, all desiugns I can find seem to rely on the VDMA for streaming however this doesn’t allow pixel by pixel streaming to HDMI out

Any help appreciated on this,
I believe Live PL streaming out of the Displayport/HDMI outputs of a Zinq Ultrascale+ MPSoC device would be beneficial for many others,

Regards,
Cameron