In Dynamics 365 for Finance and Operations you can select contact information on a worker to be private:
Once this private option is selected only users that have specific security roles can view this private contact information.
You can manage and control which security roles have access to this information by using the Global Address Book parameters>
Private location security:
Users that are assigned the selected roles from that parameter setting will be able to view the private contact information.