Hi,
If I understand correctly, you have modified the base Overlay but you did not see the modifications applied via ol?, is it true?
After having modified the Overlay, did you generate a new bitstream and implemented it on your RFSoC 4x2? What did you do for that step? Did you do like in this tutorial?
(Tutorial: Creating a hardware design for PYNQ)