Perhaps you need to stop banishing. If you still think you need protection, there's some interesting insight in the book Holy Daimon by Frater Archer:
"Think of yourself as a vessel. Normally this vessel is being continuously filled with water from many sources, and thus is in a state of overflowing sensual experience. New water pours in while old water flows out, and there is a neverending coming and going of experiences, some delightful and others painful, some of them indifferent and many invisible to our conscious minds.
"When we go into isolation, we stop all of this. We deliberately create emptiness and openness within us. We make of ourselves an untouched space, an empty vessel that attracts the attention of all sorts of spiritual beings who would love to take up residence in it and fill it with their own waters. It offers shelter and food and richness to all the spiritual beings who cannot provide these things for themselves, who prey on carrion. And carrion is exactly what such energy is to them.
"So in isolation we strive to empty our vessel of new impressions. We strive to empty it of our senses, both mental and physical. We create an empty space that will ultimately be used by our holy daimon to create a conscious communion with us. However, until then we must guard this empty vessel and ensure that we don’t get tricked and abused by other beings who would prey on our openness. This is why we seal this vacant space with joy.
"The type of joy we mean is the most wonderful protective seal. Joy is the shield that shines like the sun. And just like the sun it has no source but is self-sustaining: we have but to learn to ignite it within ourselves."
He goes on to recommend practices which can be used to bring in joy. You may find this work less 'magic' and more 'mystic.'
