Hey @Kanugent,
I just started working with the Pynq Z1. I also have my router in the other room where the pynq board is connected to the WiFi router through Ethernet.
When you first connect to pynq board through jupyter, it should have a default IP that is already set to, or you can connect through the proxy.
If you want to connect to the Pynq board wirelessly, I think you need to have a WiFi dongle. I want to do this in the future, I think this post gives information on how to do it:
RALink WiFi dongle with PYNQ/pynq/notebooks/common/wifi.ipynb
hope this helps, cheers