Where are All the Successful Rationalists?

It’s been 13 years since Yudkowsky published the sequences, and 11 years since he wrote “Rationality is Systematized Winning”.

So where are all the winners?

The people that jump to mind are Nick Bostrom (Oxford Professor of Philosophy, author), Holden Karnofsky and Elie Hassenfeld (run OpenPhil and GiveWell, directing ~300M in annual donations) and Will MacAskill (Oxford Professor of Philosophy, author).

But somehow that feels like cheating. We know rationalism is a good meme, so it doesn’t seem fair to cite people whose accomplishments are largely built off of convincing someone else that rationalism is important. They’re successful, but at a meta-level, only in the same way Steve Bannon is successful, and to a much lesser extent.

By comparison, Miyamoto Musashi, who Yudkowsky quotes extensively in the post, and who coined the phrase “the Ichi school is the spirit of winning”, appears to have been one of the greatest swordsmen of his era. According to Wikipedia, he:

  • Fought duels against the most famous schools in Kyoto, and never lost
  • Defeated an “adept” at age 13
  • Was granted the title “Unrivaled Under Heaven” by the shogun at 21
  • Single handedly ended the Yoshioka School by defeating 3 masters, and then a 70 person ambush of followers

One explanation is that rationalism entails a particular value system that guides rationalists away from becoming prominent politicians or entrepreneurs. This isn’t obviously absurd. Very successful people are often described as ambitious, smart and hardworking, but rarely as intellectually honest. Analogously, Ecclesiastical orders often had the highest literacy rates, but had philosophical objections to using that leverage to gain influence in other spheres.

Except that they totally did anyway. Pope Urban II initiated the crusades, a holy war of massive proportions. Pope Clement VII was so influential that King Henry VIII had to leave the church and invent in Anglicanism just to escape. And Pope Innocent III claimed influence over all the kings of Europe, single handedly annulled the Magna Carta, and in an act of nominative anti-determinism, directed the sack of Constantinople.

Even today, churches are enormously powerful and wealthy. The LDS has an estimated $5B in annual revenue, with an estimated $100B in funds, and protestants can make claims to nearly every US president.

Even if you think rationalism is genuinely rooted in altruism, they strongly recommend “earning to give”, which ought to result in rationalists leading hedge funds, startups and so on.

Tyler Cowen once called rationalism “just another kind of religion”, but if so, it seems to be a fairly unsuccessful one.

Still, no one can deny that they have noticed the skulls. Whatever criticism one makes of rationalists, they have likely made of themselves many times over.

Immediately after the Systematised Winning, Scott Alexander wrote Extreme Rationality: It’s Not That Great claiming that there is “approximately zero empirical evidence that x-rationality has a large effect on your practical success”, and giving several possible explanations:

  • Weakness of will: Even with good ideas, rationalists can’t execute
  • Specific knowledge beats out generalized theoretical knowledge
  • Noise

The second is particularly interesting, Scott goes on to say that “people in finance tend to know this and use specially developed x-rationalist techniques on the job already without making it a lifestyle commitment.” In addition to specialization, practitioners have the benefit of learning a system of practice built by tradition smarter than you. A person can compete against their own irrational self, but they shouldn’t expect to win against a centuries old practice.

What about dynamic fields, or new fields without precedent?

Many startup CEOs are young generalists who did not learn their craft through a career at McKinsey or an MBA program at Harvard. It’s not clear that tech entrepreneurship has a storied tradition of practice, aside from maybe the abundance of podcasts free to all.

A better excuse is that startup founders are just totally insane, in a way that precludes any rational or even rationalist person from joining their ranks. Elon Musk famously compared entrepreneurship to “chewing glass and staring into the abyss”; Paul Graham warned “If you start a startup, it will take over your life to a degree you cannot imagine”.

That’s the best case scenario where things go according to plan. The much more likely outcome is that you stagnate for years, raise money from, hire or alienate all your friends, are resented by every employee you sold on a billion dollar exit, who by the way, are the only people you ever see, all while sacrificing your physical and emotional health.

This should also be considered against a very high baseline quality of life. The alternative to running a tech company isn’t the median human existence, it’s being an incredibly well paid engineer or tech executive and retiring in your 30s.

Speaking of baselines, what exactly should we expect from the rationalist community?

If it was a bunch of uneducated basement dwellers, we shouldn’t be shocked to learn that rationalism was unable to transform them into heads of state and captains of industry.

But the SCC survey results paint a different picture. Over 40% of readers work in software engineering, IT, and computer science, with another 4.7% in finance and 3% in physics, 6.7% in engineering, and 3.8% in law. 12% have PhDs, another 25% have Master’s degrees, and another 40% have Bachelor’s.

All else equal, we should expect these people to do fairly well, or at least have the potential to once imbued with some kind of cognitive superpower.

There are two possible conspiratorial views:

  1. The world is run by rationalists, but you haven’t heard of them. From an earlier SSC post:  “large organizations tend to have a position that pretty much controls everything from behind the scenes but doesn’t have to cope with the appearance of power”

  2. The world is run by rationalists, but they haven’t outed themselves.

As with all conspiracies, these views are not only crazy, but also unfalsifiable. I could just as easily claim that the world is secretly run by freemasons. From a Bayesian perspective, the evidence is equally well explained by the both hypotheses, so we should stick with our prior that there is not a conspiracy.

Instead, I propose the weak conspiracy, which is that many successful people have read rationalist blogs, but do not make it part of their identity. For example:

Of course, now the question is: “do rationalists become successful, or do successful people just like blogs on the internet?” We might try to infer causality from timing. As of 2009, every one of those people was already successful, which points in favor of the latter hypothesis.

Instead of more theorizing, I’ll end by offering my own testimony.

The primary impacts of reading rationalist blogs are that 1) I have been frequently distracted at work, and 2) my conversations have gotten much worse. Talking to non-rationalists, I am perpetually holding myself back from saying “oh yes, that’s just the thing where no one has coherent meta-principles” or “that’s the thing where facts are purpose-dependent”. Talking to rationalists is not much better, since it feels less like a free exchange of ideas, and more like an exchange of “have you read post?”

There are some specific areas where rationality might help, like using Yudkowsky’s Inadequate Equilibria to know when it’s plausible to think I have an original insight that is not already “priced into the market”, but even here, I’m not convinced these beat out specific knowledge. If you want to start a defensible monopoly, reading about business strategy or startup-specific strategy will probably be more useful than trying to reason about “efficiency” in a totally abstract sense.

And yet, I will continue reading these blogs, and if Slate Star Codex ever releases a new post, I will likely drop whatever I am doing to read it. This has nothing to do with self-improvement or “systematized winning”.

It’s solely because weird blogs on the internet make me feel less alone.

Before reading A Human’s Guide to Words and The Categories Were Made For Man, I went around thinking “oh god, no one is using language coherently, and I seem to be the only one seeing it, but I cannot even express my horror in a comprehensible way.” This felt like a hellish combination of being trapped in an illusion, questioning my own sanity, and simultaneously being unable to scream. For years, I wondered if I was just uniquely broken, and living in a reality that no one else seemed to see or understand.

So the defense of “rationality as systematized winning” is not even a causal one. I don’t claim to have benefited in any real way from rationality, nor can I really recommend it to anyone who isn’t already inclined to read these blogs. The point of winning is not to make money, or gain influence, or even to altruistically produce more QALYs. The point is that for my reality to even feel legitimate, it needs to have bearing on the consensus shared reality.

Now that Slate Star Codex is gone, this project feels more necessary than ever. Substack promised to fund independent writing, but instead, has largely replaced eclectic blogs with rapid-fire newsletters that follow the news-cycle. The kinds of people who would have been rationalist writers are instead mass-producing insight-porn on Twitter, or starting Progress Studies blogs to share historical trivia.

A smart person would take this opportunity to join the bandwagon before it takes off. But I’m not smart, just rationalist, so instead I’m here on a poorly styled blog with a long name lamenting the last days of a community.

Or as Richard Hamming should have said: “the purpose of computers is community, not insight.”

[EDIT 10/16/2020]

Thing of Things points out:

I think a formative moment for any rationalist– our “Uncle Ben shot by the mugger” moment, if you will– is the moment you go “holy shit, everyone in the world is fucking insane.”

…I don’t think it’s an accident that a lot of rationalists are mentally ill. Those of us who are mentally ill learn early and painfully that your brain is constantly lying to you for no reason. I don’t think our brains lie to us more than neurotypicals’ brains do; but they lie more dramatically, about things society is not set up to accommodate, and so the lesson is drilled in.

So perhaps rationalism appeals to extremely irrational people, who are, through immense effort and many blogs posts, able to approach baseline sanity.

The SSC survey I cited was from 2019. Maybe all the rationalists with PhDs and lucrative tech jobs in 2019 were totally devoid of any hope for the future in 2009, and it is only thanks to these blogs that they’ve achieved the success they have.

I don’t know of any data that supports this, but it’s not obviously wrong.

[EDIT 02/18/2021]

Byrne Hobart writes:

The influence of people who read rationalist blogs, but don’t self-identify as rationalists, is quite wide—the blogs are very widely followed in technology circles, and anecdotally have a large audience in the more quantitative branches of finance. Identifying as a rationalist is a losing move, because non-rationalists will think it’s weird (objectively true!) and rationalists will be relatively indifferent to a personal label

[EDIT 03/08/2021]

Scott Alexander has some data from the LessWrong survey showing that EAs do not have more mental health problems than the general LW community. But it’s possible they all have mental health problems. I wouldn’t bother comparing this to results about the general population since survey responses depend a lot on the particular survey being administered.

For what it’s worth, I don’t think “mental illness” explains a lack of success. Especially among startup founders, at least according to myth, there are high rates of various “mental health problems”. Though maybe some are more conducive to success than others, and it’s not useful to talk about the generic category.

The Great American Election Lottery

Americans love gambling.

Your odds of winning the Powerball jackpot are just 1 in 292,000,000 (compared to 1 in ~40,000 odds of being killed by lightning). Since only half of Powerball winnings go towards prizes, we can infer that expected value is 50 cents on the dollar.

And yet, lotteries remain incredibly popular. Around half of American adults play state lotteries, and the U.S. Bureau of Labor Statistics reports average spending of $834 each year on lottery tickets and betting pools.

Meanwhile, US voter turnout overs just over 50%.

Given the unreasonable popularity of lotteries, why can’t we just hand out lottery tickets with ballots?

The idea of financially motivating votes isn’t unprecedented. Australians who don’t vote are fined $15, up to $37 on continued offense.

And neither is the idea of a civic lottery. In order to cut down on tax evasion, Taiwan introduced a lottery on sales receipts in 1951, leading to a 75% increase in collected taxes. Even after increasing the payout, the Taiwan Finance Ministry today pays a mere $20 million USD in prizes.

Fans of behavioral economics may notice a similarity to the classic A Fine is a Price paper, which describes how charging parents for late daycare pickup actually aggravated the problem. The authors propose that:

When help is offered for no compensation in a moment of need, accept it with restraint. When a service is offered for a price, buy as much as you find convenient.

Accordingly, we may worry that in the context of elections, voters are currently motivated by civic duty, but would lose this motivation in favor of a purely financial one. If the lottery winnings aren’t sufficiently large, we risk crowding out incentives and actually harming turnout. Even if turnout is increased, people may vote merely for the money, and make worse or more selfish decisions than if they were voting out of civic duty.

At least with regards to the first risk, Australia has been largely successful, achieving over 90% turnout in recent elections.

Logistically, a lottery would be easier than it sounds.

Voter registration lists are public information and include each voter’s address. Even without an official lottery, any donor could decide to hold a lottery, and mail checks to a random set of addresses after the election.

Unfortunately, this is also totally illegal. U.S. Code § 597 reads:

Whoever makes or offers to make an expenditure to any person, either to vote or withhold his vote… shall be fined under this title or imprisoned not more than two years

You could argue that retroactively paying a few random voters is different from paying a particular person to vote, but it’s still a big legal risk.

Still, 2 years isn’t the end of the world, especially since people regularly dedicate entire lifetimes to political activism.

Unemployment Part 2 - How to Save Yourself

Mandatory warning that I’ve used this system for exactly 3 days:

And secondary mandatory warning that nearly all advice is bad.

In Part I, I proposed a short list of solutions to working independently after quitting your job. Here’s the long version with details fleshed out.

Accept that you max out at 4 hours a day, and make sure you actually hit it every day.
The major caveat here is that it is incredibly difficult to consistently work 4 hours a day. Nearly no one can pull this off, and even people with stressful full time jobs are often just faking it by spending 8 hours on Slack and in meetings.

So while 4 hours a day sounds downright leisurely, you can’t get tricked into complacency.

If 20 hours a week sounds like easy mode, the easiest way to become dramatically more productive is not to “hustle harder”, but to add weekends. This puts your total weekly hours at 28, a 40% increase over only working weekdays, but still keeps you at 30% under a normal 40 hour workweek.

Also note that you’re still “on” the remaining 140 hours a week. That time is for making sure you’re healthy and energetic enough to do 4 hours work very consistently. Most people don’t actually know how to relax, just how to “blow off steam”. If you go out to a bar after work, you don’t feel more motivated the next day, you just feel more able to handle another 8 hours in an office.

Find sources of lasting intrinsic motivation that aren’t based around feelings of inadequacy.
If you’re a smart person, you’ve spent your whole life winning competitions, getting praise from authority figures, checking boxes and gaining prestige.

Understand that there is no difference between a superiority and inferiority complex. The feeling of being great just means you value your ego, and will fear losing it even more.

I don’t have any concrete advice here, other than to take it seriously, give it time, and hope that after years of education and employment you still have any genuine interests remaining.

Measure yourself by what you’ve done, not how many hours you’ve put it
This is a bit misleading. If you’re working independently, you likely won’t have any “accomplishments” in a conventional sense for many months.

The real advice is Scott Adams’, which is to follow a system instead of a goal. If you want to learn a new language, don’t try to measure progress towards fluency, just set up a simple system (study flash cards 1 hour a day, watch 30 minutes of content, write 10 sentences in your journal using the new words you learned) and measure progress by how consistently you’re able to follow the system.

A month in, you can see how the system is going and try to establish progress on external goals, but that can’t be the first step. Day to day, progress is never going to be linear, so winning has to be about behaving the right way, not achieving the right results.

If you’re like me and love abstraction, not hyper-optimizing the system at every opportunity feels incredibly wasteful. But the truth is for most pursuits, a very simple system will get you 80% of the way there, and much much further than an optimal system poorly followed.

More deeply, goals and systems are two parts of the same coin, and you can’t fully design the system without spending time engaged in practice. You might discover after a month that you derive way more joy from conversation than from writing, and decide to shift your language learning focus, but that insight won’t happen from taking the bird’s eye view.

Enjoy your newfound freedom, but in ways that don’t directly compete with your real aims.
I banned myself from video games throughout my last job, which means that as soon as I quit, I binged everything I had been denying myself.

Some hobbies just feel all-consuming like this. If I get deeply involved in a TV show or game, I basically just have to give up on the entire week and try to get work done later.

In other cases, the activity might not be time consuming, but will still impede efforts elsewhere. The most obvious examples are drinking, sleep deprivation, and having a poor diet. You can stop taking shots at midnight, but still feel horrible at noon the next day.

The only thing I’ve found effective for quitting addictive habits is binging to the point of self-hatred. I will stay up all night playing video games, and then hate myself enough to stop for the next 3 months. This might not sound particularly healthy, but outside of alcohol, I don’t actually think it’s a serious harm.

Create psychological distance by choosing a particular time and place to work, if necessary, inform everyone you live with of your “official work hours”.
This is fairly straightforward. The only caveat is that it might be embarrassing to tell your parents or housemates that you’re “writing a blog on the internet” or “doing independent research” or “starting a startup” and can’t be interrupted.

I’m even more embarrassed to write about this publicly, but I literally solved this problem by becoming nocturnal, and doing all my writing after my housemates have gone to bed.

Conclusion.
This isn’t meant to be generic productivity advice. I’ve read so much of those posts, and gotten basically no value from them. This won’t solve all your problems, but hopefully it will at least make you feel less alone if you’re struggling with similar issues, or give you a jumping off point to figure out your own system.