S8 ARP resolution failure on untagged ports

I noticed recently with my S8 that it can’t resolve ARP for any hosts within its management VLAN (not VLAN 1) unless the ports to those hosts have the management VLAN as tagged.

If the management VLAN is untagged on a port, then any hosts on that port cannot be reached.

I assume this is not expected behavior?