I cannot really comment whether or not it is him, as I have never worked with Lucifer. Some spirits have tendencies thst can be predictable, while others a bit more unpredictable (I would put Belial in that category). Either way, something is going on and wiping the slate clean will likely help things. As for banishment, there are many, many different ways to do it. You have LBRP (Lesser Banishment Ritual of the Pentagram, which has been explained quite well on youtube, including by EA), smudge ceremonies, Sword Banishment, etc. Here are a couple threads that might help you out, but i would recommend also looking into the search function.
That second one will require fire safety of course.