Companions, familiars, and spirits close to you are linked to you. A banishing ritual wont get rid of them unless your intent is to be rid of EVERYONE. And even then, with the connection, your familiars can come right back. Itd be best to verify whether or not the mean shit lurking is connected to you or just got in. Or whether or not they were invited by your succubus.