Eigenmorality And The Dark Enlightenment

Comment

Jon Evans

Contributor

Jon Evans is the CTO of the engineering consultancy HappyFunCorp; the award-winning author of six novels, one graphic novel, and a book of travel writing; and TechCrunch’s weekend columnist since 2010.

More posts from Jon Evans

This is a post about good vs. evil and right vs. wrong, but don’t worry, it’s highly technical.

Let’s start with Stormfront, the white-supremacist hate site that attracts circa 300,000 unique American visitors per month, and the recent analysis of its members (and follow-up) by Seth Stephens-Davidowitz in the New York Times. Some numbers you probably didn’t expect:

when you compare Stormfront users to people who go to the Yahoo News site, it turns out that the Stormfront crowd is twice as likely to visit nytimes.com … 64% identify their age as under 30 … no relationship between monthly membership registration and a state’s unemployment rate … Nearly 80 percent of Stormfront fans have more than 100 Facebook friends. Nearly 60 percent have more than 200.

In related news, I was ego-googling the other day — look, I’m not proud of this, but I do it alone at home with all the doors and windows closed, and it doesn’t harm anyone — and I came across a response to one of my TC posts that ended with the line:

Due to the heritability of poverty and low IQs, we propose eugenics as the most effective long term solution for controlling entitlement spending.

I assumed this was some kind of Swiftian satire, but no, its author announces himself as part of the “Grey Enlightenment,” a less extreme version of the Dark Enlightenment neoreactionaries that Klint Finley wrote about on TechCrunch last year.

The Baffler subsequently published an excellent primer on the neoreactionary movement, complemented well by Vocativ’s FAQ. (If you want a palate cleanser after reading those, here’s a lengthy Anti-Reactionary FAQ.) Briefly, the neoreactionary movement:

advocates an autocratic and neo-monarchical society. Its belief system is unapologetically reactionary, almost feudal … liberal progressivism is seen as a state religion … the darkly enlightened see social hierarchies as determined not by culture or opportunity but by the cold, hard destiny embedded in DNA.

Hence their focus on “human biodiversity,” a.k.a. racism, and eugenics.

I don’t want to spend too many words on Stormfront and the neoreactionaries here, as I do have a larger point to get to, but you may well be wondering: why pay any attention to these assholes at all? After all, Stormfront’s 300,000 American users per month is still less than 0.1% of the population, and it’s possible that the handful of neoreactionary bloggers are just trying to use shock value to get attention. Why feed the trolls?

But I’m afraid I don’t think it’s that simple. For one thing, as hateful and wrongheaded as they may be, some of these people are clearly highly intelligent, and pour an enormous amount of effort into their work. It seems apparent to me that they’re not just doing it for shock value; they truly believe what they’re saying. I think it’s worth investigating how those beliefs form, and how and why their adherents cluster online.

The Baffler also suggests

Neoreactionaries are explicitly courting wealthy elites in the tech sector as the most receptive and influential audience … the neoreactionaries do seem to be influencing the drift of Silicon Valley libertarianism, which is no small force today

…but while I’m far from a libertarian, I’m largely unconvinced by what reads like an attempt to lump in with the Dark Enlightenment everyone who suggests “the status quo is pretty screwed up, maybe we should experiment with other sociopolitical systems” — you know, people like me. I’m sure there are Valley figures who do sympathize; but I’m also sure they’re a distinct minority.

It does seem clear, though, that technology has enabled the entire Dark Enlightenment movement. In part because it’s such a force multiplier that some people with tech skills have begun to think of themselves as part of a global elite, and then made the fundamental attribution error and concluded that this is because they are inherently better than other human beings; in part because, as I wrote last week, the Internet allows people who would otherwise have been loner outcasts to band together.

Circa 99% of the time this is a very good thing. The other 1%, though, gives us communities like “The Red Pill,” the misogynist hate site which became infamous after Elliot Rodger’s killing spree in Santa Barbara earlier this year.

What interests me about hate sites and fascist ideologies is, again: how do people find their way to these communities, and why do they join them? How and why do they forge hateful and dehumanizing beliefs in the midst of a society which — finally, after many years — generally recognizes them as wrong?

Well. Perhaps there might actually be a way to find out. In a formal, quantified, scientific way, no less. I give you MIT professor Scott Aaronson’s essay on eigenmorality.

It’s a terrific piece, but be advised, it’s written for a scientific audience, so it assumes that you know e.g. what an eigenvector is. (I confess I had to refresh my own memory at Wikipedia, as I haven’t much encountered matrix mathematics in the wild since acquiring my EE degree mumblemumble years ago.) To very briefly extremely oversimplify, though, it suggests that we can use an algorithm similar to Google’s original PageRank to measure morality across the human population:

A moral person is someone who cooperates with other moral people, and who refuses to cooperate with immoral people … How can we possibly know which people are moral? … linear algebra can come to the rescue! … by simply finding the principal eigenvector of the “cooperation matrix,” we then have our objective measure of morality for each individual.

(He goes on to propose a second, largely separate notion, eigendemocracy, which is even more interesting but probably outside the scope of this post. But you should go read about it.)

We don’t have a planetary-scale graph of who cooperates with one another…but we do actually have a reasonable approximation of who associates with one another. It’s called Facebook. Meaning, it seems to me, that we — by which I mean Facebook itself — may actually have the power to measure and quantify individual (relative) morality. (Which is presumably a vector in some kind of N-dimensional space rather than a single-digit rating from 1 to 10.) What’s more, Facebook could actually observe how that value changes over time.

So, in theory at least, it may already be within our power to identify some of the factors that cause otherwise intelligent people to adopt and propagate essentially fascist and misogynist ideas, such as Stormfront, the Dark Enlightenment, and the Red Pill. That, I think — unlike certain other examples I could name — would be an experiment worth trying.

More TechCrunch

Around 550 employees across autonomous vehicle company Motional have been laid off, according to information taken from WARN notice filings and sources at the company.  Earlier this week, TechCrunch reported…

Motional cut about 550 employees, around 40%, in recent restructuring, sources say

The deck included some redacted numbers, but there was still enough data to get a good picture.

Pitch Deck Teardown: Cloudsmith’s $15M Series A deck

The company is describing the event as “a chance to demo some ChatGPT and GPT-4 updates.”

OpenAI’s ChatGPT announcement: What we know so far

Unlike ChatGPT, Claude did not become a new App Store hit.

Anthropic’s Claude sees tepid reception on iOS compared with ChatGPT’s debut

Welcome to Startups Weekly — Haje‘s weekly recap of everything you can’t miss from the world of startups. Sign up here to get it in your inbox every Friday. Look,…

Startups Weekly: Trouble in EV land and Peloton is circling the drain

Scarcely five months after its founding, hard tech startup Layup Parts has landed a $9 million round of financing led by Founders Fund to transform composites manufacturing. Lux Capital and Haystack…

Founders Fund leads financing of composites startup Layup Parts

AI startup Anthropic is changing its policies to allow minors to use its generative AI systems — in certain circumstances, at least.  Announced in a post on the company’s official…

Anthropic now lets kids use its AI tech — within limits

Zeekr’s market hype is noteworthy and may indicate that investors see value in the high-quality, low-price offerings of Chinese automakers.

The buzziest EV IPO of the year is a Chinese automaker

Venture capital has been hit hard by souring macroeconomic conditions over the past few years and it’s not yet clear how the market downturn affected VC fund performance. But recent…

VC fund performance is down sharply — but it may have already hit its lowest point

The person who claims to have 49 million Dell customer records told TechCrunch that he brute-forced an online company portal and scraped customer data, including physical addresses, directly from Dell’s…

Threat actor says he scraped 49M Dell customer addresses before the company found out

The social network has announced an updated version of its app that lets you offer feedback about its algorithmic feed so you can better customize it.

Bluesky now lets you personalize main Discover feed using new controls

Microsoft will launch its own mobile game store in July, the company announced at the Bloomberg Technology Summit on Thursday. Xbox president Sarah Bond shared that the company plans to…

Microsoft is launching its mobile game store in July

Smart ring maker Oura is launching two new features focused on heart health, the company announced on Friday. The first claims to help users get an idea of their cardiovascular…

Oura launches two new heart health features

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI considers allowing AI porn

Garena is quietly developing new India-themed games even though Free Fire, its biggest title, has still not made a comeback to the country.

Garena is quietly making India-themed games even as Free Fire’s relaunch remains doubtful

The U.S.’ NHTSA has opened a fourth investigation into the Fisker Ocean SUV, spurred by multiple claims of “inadvertent Automatic Emergency Braking.”

Fisker Ocean faces fourth federal safety probe

CoreWeave has formally opened an office in London that will serve as its European headquarters and home to two new data centers.

CoreWeave, a $19B AI compute provider, opens European HQ in London with plans for 2 UK data centers

The Series C funding, which brings its total raise to around $95 million, will go toward mass production of the startup’s inaugural products

AI chip startup DEEPX secures $80M Series C at a $529M valuation 

A dust-up between Evolve Bank & Trust, Mercury and Synapse has led TabaPay to abandon its acquisition plans of troubled banking-as-a-service startup Synapse.

Infighting among fintech players has caused TabaPay to ‘pull out’ from buying bankrupt Synapse

The problem is not the media, but the message.

Apple’s ‘Crush’ ad is disgusting

The Twitter for Android client was “a demo app that Google had created and gave to us,” says Particle co-founder and ex-Twitter employee Sara Beykpour.

Google built some of the first social apps for Android, including Twitter and others

WhatsApp is updating its mobile apps for a fresh and more streamlined look, while also introducing a new “darker dark mode,” the company announced on Thursday. The messaging app says…

WhatsApp’s latest update streamlines navigation and adds a ‘darker dark mode’

Plinky lets you solve the problem of saving and organizing links from anywhere with a focus on simplicity and customization.

Plinky is an app for you to collect and organize links easily

The keynote kicks off at 10 a.m. PT on Tuesday and will offer glimpses into the latest versions of Android, Wear OS and Android TV.

Google I/O 2024: How to watch

For cancer patients, medicines administered in clinical trials can help save or extend lives. But despite thousands of trials in the United States each year, only 3% to 5% of…

Triomics raises $15M Series A to automate cancer clinical trials matching

Welcome back to TechCrunch Mobility — your central hub for news and insights on the future of transportation. Sign up here for free — just click TechCrunch Mobility! Tap, tap.…

Tesla drives Luminar lidar sales and Motional pauses robotaxi plans

The newly announced “Public Content Policy” will now join Reddit’s existing privacy policy and content policy to guide how Reddit’s data is being accessed and used by commercial entities and…

Reddit locks down its public data in new content policy, says use now requires a contract

Eva Ho plans to step away from her position as general partner at Fika Ventures, the Los Angeles-based seed firm she co-founded in 2016. Fika told LPs of Ho’s intention…

Fika Ventures co-founder Eva Ho will step back from the firm after its current fund is deployed

In a post on Werner Vogels’ personal blog, he details Distill, an open-source app he built to transcribe and summarize conference calls.

Amazon’s CTO built a meeting-summarizing app for some reason

Paris-based Mistral AI, a startup working on open source large language models — the building block for generative AI services — has been raising money at a $6 billion valuation,…

Sources: Mistral AI raising at a $6B valuation, SoftBank ‘not in’ but DST is