The same thing used to happen to me as well. I found speaking in a low conversational tone, like the way you would have a private conversation with someone in the midst of a group helps. It’s not quite a whisper, but not full volume either.
You can start using mantra meditation to get into trance, so while speaking with entities in the middle of the ritual, your brain, already accustomed to using faculty of speech in trance, won’t suddenly fall back.
Typically I welcome the spirit telepathically, in other words talk to em in your head while their with you, it’s the same as speaking to them verbally only it will probably not take you out of trance.