Users can see eachother

Sometimes on a project I dont want people to see the other users I have, I want to be able to only assign people per project and have them selectable in the assigning list, not everyone.
So right now im considering deleting all my staff so a consultant cant see their names. 

Security/ Assigned Users for Allocation/ Assigning.