Put up wards so it doesn’t even matter, and you don’t have to start trying to block every person, some of whom you will never know about. This is part of having “good spiritual hygiene”. It’s ok to notice unwanted energy coming in but you should be able to let it run through and off like water off a ducks back. Do not be afraid of it.