User blog:Darkfowl75/NO One wants me around

Everywhere I go, every single townsperson tells me to stay back because my spell is dangerous, even when I unequip everything they continue to do it! Anyone else have this problem or know why it happens?