Python overlay/driver changes require reboot

I have added my own custom python driver to the base overlay file in /home/xilinx/pynq/overlays/base/, but it seems that none of the changes take effect until I reboot the device using sudo reboot. So the questions are:

  1. Am I putting the IP driver in the correct place?
  2. Is there a way to get pip to recognize that the file has changed without rebooting every time?

Version: 3.0.1
Board: RFSoC 4x2