This post is mainly to remind me where to find this feature, hopefully it will help you as well. This will help you fine tune the recommendations that Azure Security Center gives you.

https://techcommunity.microsoft.com/t5/Security-Identity/