Direct connection between two VMs on 2 Proxmox hosts

I have two Proxmox hosts (host A, and host B), each with a single public IP address. I have two virtual machines:
VM AA running on host A, VM BB running on host B. They are using Linux bridges on Proxmox. When the VMs connected to each other, all the connections were made through Tailscale relays. Is there any possible solution to connect the two VMs directly, without using Subrouter?

Thank you.

Is IPV6 an option? That makes direct connections a whole lot easier from I’ve read on Tailscale posts.