It's very uncomfortable finding yourself in a situation where people are treating magic as a serious topic. Your options are basically "dissemble to keep the peace" or "admit that you think the whole thing is absurd and you consider the rest of the company gullible and a little pathetic." At least with casual discussions of astrology you can just ask people about their lives without actually engaging with the magic component. When people start talking about "manifesting" shit I turn green and leave the room.