I think you already answered your own question. 
If you feel a pull, trust yourself and go with it. You can do anything you want to.
You might have expectations that are holding you back as well. Many many people don’t sense the entities, they come anyway and your magick will work.
Try earbuds for the music, and build a temple in the astral you can visit in meditation to visualise the ritual instead of physically doing it.
We have a few people here who can’t do rituals like that, and “go stealth” this way.
Here’s some posts about using astral temples:
https://forum.becomealivinggod.com/search?q=astral%20temple