Tailscale causing spotty internet

Tailscale version: 1.34.2
Your operating system & version: Linux and Android

Hi, I started using Tailscale on my personal devices a couple of weeks ago with 2 linux devices, 1 android and 1 RPi in my tailnet. Since then I have seen network issues where in some sites will randomly not load with network error until I hit refresh 4-5 time. I turned off Tailscale on all devices 2 days ago and things have returned to normal so it’s not an ISP issue.

Would really appreciate If anyone can provide a solution or give me some pointers to debug further because at this point I am not even sure what I should even google.

Would be happy to provide any further information.