Interesting (to me at least): my domain had an IPv6 AAAA record pointing to a different server which was getting picked first over the IPv4 changes I made.