This "super-intelligence" stuff is frustrating, because it comes so very close to a real observation. It's seeing the forest without the trees. Information, encoded as narrative, exists within people. When that narrative - that story - exists in enough people, it produces a kind of emergent behavior. Stuff like cultures, nations, money, and religion. But it's not sentient, in the same way an anthill is (probably) not sentient. Oh, the ants definitely are -- in their own little ant way. And people are sentient. But the emergent behavior of the 'social organism'? It's complex, complicated, sure. But it isn't a mind. It exists between minds. Pratchett called it 'extelligence' - as opposed to intelligence.

All that is to say, Roko invented Satan again. He can't grapple with the fact that living, breathing, rational, sentient people can reach different conclusions and think different thoughts than himself, so it has to be some sPoOkY "unfriendly superintelligence" that's actually the cause. 'Cus when it's Satan, you don't have to talk to other people. You don't have to do the uncomfortable work of having a discussion. No need to consider another's perspectives. You just call them satanic (or is it an 'anti-human egregore'...?) and wash your hands of all that unappealing work.