Configuring MagicDNS on k8s with ts-sidecar

Not having much luck getting MagicDNS setup

Tried what was described here: Feature Request: Kubernetes Operator · Issue #502 · tailscale/tailscale · GitHub, but instead of the beta domain, I’m using my own magic DNS fun domain name:

    my-ts-domain.ts.net:53 {
        loop
        cache 10
        forward . 100.100.100.100
    }
    .:53 {
        log
        errors
        health {
          lameduck 5s
        }
        ready
        kubernetes cluster.local in-addr.arpa ip6.arpa {
          pods insecure
          fallthrough in-addr.arpa ip6.arpa
        }
        forward . /etc/resolv.conf
        prometheus :9153
        cache 30
        loop
        reload
        loadbalance
    }

then restarted all coredns pods

domain names are not resolved, tried going into a pod and doing a lookup on the tailscale DNS directly with nslookup

k exec -it <pod> -- bash
nslookup macmini.my-ts-domain.ts.net 100.100.100.100
Server:		100.100.100.100
Address:	100.100.100.100:53

** server can't find macmini.my-ts-domain.ts.net: SERVFAIL

Tailscale is running in sidecar mode on the cluster, using IPs directly works fine, just no magicdns

Any idea what to try here?