Linux drops all connections when using exit node

Using Tailscale 1.32, whenever tailscale up --exit-node= is set, my Ubuntu 22.04 drops all connections including SSH connection and I cant go back in unless I turn off tailscale through serial. How can I still allow connections while an exit node is being used?