Had to dig a bit for this one as it was not immediately clear to me.
When you are trying to remote from a Mac to an AzureAD (or Entra ID) joined Windows device using Microsoft's Remote Desktop app, you have to use a special username.
You need to use: