I went into my router config to look around, came across this.

Disable SPI Firewall - The SPI (Stateful Inpection) Firewall protects your LAN against Denial of Service attacks. This should only be disabled in special circumstances.

After checking it, problem seems to have gone away.