A while back, when some members of the forum were being troubled by a rather pesky spirit, using swastikas against it proved effective, so maybe give that a try (use the original swastika, NOT the Nazi version, which actually goes in the wrong direction) or an equal armed cross.
The exorcism banishing from KoF is effecitve, but it does not create a boundary to prevent something from returning.