No, you shouldn’t. You are targeting the specific demons that are attacking you, but the demons you invite into your space will not be affected. That is why people who work with Lucifer can use the Lesser Banishing Ritual of the Pentagram with him in the room and it won’t affect him. Your intention with any defense or banishing is what matters. If you articulate that you are only getting rid of what is causing you harm, then Belial or any other demon you purposely called, will not be affected. You can still get rid of the “hooks” and not worry about getting rid of Belial or whatever demon you are working with.
I used Belial’s gateway symbols and called upon him, while in the morning, I used Damon Brand’s angelic Circle of Power, and it didn’t affect Belial at all.
You can use angels to get rid of angels, you can use demons to get rid of angels, you can use angels to get rid of demons and you can use demons to get rid of demons.