This is an evergreen post. It’s linked from the header, and will be updated periodically.

Lambda School Incentives

Google Sheet
Post: Lambda School’s Incredibly Naive Incentive Alignment
Description: Modeling Lambda School’s ISA incentive structure with consideration of taxation. A fully functional California income tax calculator.
Findings: There is only a brief window where student and LS returns grow in tandem. LS is mostly not aligned with students, or actually incentivized against their interests. Based on student outcome data, only around one third of LS students fall within the incentive alignment window.

Independence Referendums

Google Sheet
Post: Base Rates on Secession
Description: Historical data on Independence Referendums from Wikipedia subjected to sensitivity analysis.
Findings: The rate of referendums per country per 4 year period varies by 4x depending on when you start counting. It’s at least 0.01, and at most 0.04 if you start counting right as the Soviet Union collapses.

TSMD and Intel R&D Spending

Google Sheet
Post: Isolated Demands for Rigour in New Optimism
Description: I extend the dataset from Bloom et al.’s Are Ideas Getting Harder to Find? to include 2016-2019 data from 10-K filings, adjusted for exchange rates
Findings: Intel nominal R&D peaked in 2018. TSMC nominal R&D continues to increase exponentially.

Herd Immunity Guesstimate

Google Sheet
Post: Contra StatNews: How Long to Herd Immunity?
Status: Out of date, useful as a template for future modeling.
Description: Toy model of time to herd immunity based on vaccine acceleration, cases per day and different immunity thresholds.

Giving What We Can Growth

Google Sheet
Post: Why Hasn’t Effective Altruism Grown Since 2015?
Description: Scarped archive.org data for GWWC member count, dollars pledged and donations actualized.
Findings: Growth has continued, growth rate peaked in 2015.

Open Philanthropy and Good Ventures Allocation

Google Sheet
Post: Why Hasn’t Effective Altruism Grown Since 2015?
Description: Grant databases from Open Philanthropy and Good Ventures aggregated by focus area and year.
Findings: Both increased rapidly from 2015 to 2017, and have sort of stagnated since. Global Health & Development is around 34% of all Open Philanthropy giving. Scientific Research is another 16%.

Substack Author Experience

Google Sheet
Post: How to Become Famous on Substack Overnight (in Ten Years)
Description: Top 25 free Substack authors from the old leaderboard and the time they’ve spent on Substack. Years of previous experience and notable work for the top 10.
Findings: Top Substack authors have around 10 years of prior experience in research or writing.

Byrne Hobart’s Portfolio

Google Sheet
Post: The Byrne Hobart Portfolio
Description: Scaped stock ticker disclosures from Byrne Hobart’s The Diff. Historical prices at the time of disclosure and performance since.
Findings: Subject to some assumptions, this portfolio dramatically outperformed hedge funds.

Constitutional Amendments

Google Sheet
Post: Wake Up, You’ve Been Asleep for 50 Years
Description: Proposal date of constitutional amendments that were later successfully ratified.
Findings: There were long gaps with no proposals leading to ratification from 1804 – 1865, 1870 – 1909 and 1972 – present.

Founders of Top 10 YC Startups

Google Sheet
Post: Replying to Robert Wiblin on Young Rationalists, Empirical Estimates of Golden Handcuffs
Description: Investigation into the backgrounds of top YC founders as ranked here.
Findings: Median age at founding was 27, median age now is 37. Median age of startup is 9 years. Founders attend elite universities, but don’t typically work at large or prestigious companies.

Google Alumni Estimate

Google Sheet
Post: Empirical Estimates of Golden Handcuffs
Description: Based on historical headcount data and simulated churn, I estimate how many people have ever worked at Google up through 2010.
Findings: Although Google’s employee count in 2010 was 24,400, I estimate there were an additional 25,400 ex-Google employees.

Model of Correlated Returns

Google Sheet
Post: Correlated Returns are Insufficient for True Alignment
Description: Modeling correlated returns in domains without proper incentive alignment, followed by seemingly correlated returns adjusted for opportunity cost.

Miike vs Tarantino

Google Sheet
Post: No One is Even Trying
Description: Rotten Tomatoes critic and audience score for the top 10 movies of Takashi Miike and Quentin Tarantino.
Findings: Miike’s top 10 movies are as well reviewed as Tarantino’s. Meanwhile, Miike has made 10 times as many movies overall.

This is an evergreen post. It’s linked from the header, and will be updated periodically. If I’ve made mistakes not listed here, let me know and I’ll issue a correction.

Vaccine Acceptance

Post: Was Vaccine Production Actually Delayed?
Summary: I wrote that historical ills, including the Tuskegee study may play a role in diminishing vaccine acceptance. Two links from Marginal Revolution (1, 2) indicate that there is no link.
Severity: Minor. This was an appendix to the post, and not central to the argument. Both links are to article published after my post, but one references this study published in 2007. So it only has a minor impact on my argument, but I am moderately embarrassed.

Techno-Pessimism

Post:: Isolated Demands for Rigour in New Optimism
Summary: Noah Smith is currently on part 3 of a 4 part rebuttal. I haven’t taken a good look yet, but will write a response if appropriate once the series is complete.

Substack

Post: How Substack Became Milquetoast

Type: Factual errors.
Summary: I wrote that Substack had 44 employees based on their LinkedIn profile. Nadia corrected me, they only had 17 employees at the time.
Severity: This weakens my argument that Substack has failed to use it’s immense resources effectively, but does not defeat the central thesis and is only mentioned in an epilogue to the main article.
Response: The article is corrected, with the original error preserved for posterity. An apology was issued over email.

Type: Punching down.
Summary: When I wrote this article, Substack was widely hyped, and had received little substantial criticism. Since then, they have been the subject of various critiques, some of them quite poor. As a result, I somewhat regret associating with this side of the argument. See for example, the misleading NYT headline The Site Trump Could Run To Next, and Here’s why Substack’s scam worked so well. My critique was focused on Substack as a replacement for eclectic blogs. I neglected to mention that it seems to be a much better replacement for op-ed pieces, and many of my criticisms do not apply in this capacity.

Effective Altruism Slowing Down

Post: Why Hasn’t Effective Altruism Grown Since 2015?
Type: Incomplete analysis.
Summary: Katja Grace wrote a reply, pointing out that I neglected several pieces of evidence pointing at continued growth. She was kind enough to email this to me directly.
Response: I wrote a reply here, agreeing with many of Katja’s points, but defending the bulk of my original piece.

Effective Altruism Shifting Priorities

Post: Responses and Testimonies on EA Growth
Type: Misattribution.
Summary: Scott Alexander wrote this comment, which I attempted to summarize in a follow up post. He then wrote that my summary of his position did not accurately capture his views.
Response: The summary was amended, and a retraction was added as a footnote.

S&P Annualized Returns

Post: The Byrne Hobart Portfolio
Type: Factual error.
Summary: I wrote that the S&P had returned “113.7% annualized since the May 2020 bottom”. The bottom was in March, not in May, giving annualized returns of 76.6%, not 113.7%.
Severity: Minor. The article is about how good Byrne’s portfolio is, and the mistake only strengthens this stance.
Response: This is corrected in the article. The original mistake is preserved and noted.

Forecasting Herd Immunity

Post: Contra StatNews: How Long to Herd Immunity?

Type: Misinterpreting evidence.
Summary: I wrote that antibodies only last 8 months. Alvaro noted that the papers actually indicate antibodies lasting at least 8 months.
Severity: Moderate. This alters projections by 1-2 weeks depending on other parameters. I was careful to list out model assumptions, but had said that antibody duration was among my more confident assumptions. There is an “Speculative armchair epidemiology” warning at the top of the article. This does not affect the central criticism of the original Stat News article. I repeatedly noted that the estimates should not be taken too seriously.
Response: This is noted in the article with a detailed correction.

Type: Mistaken assumptions.
Summary: Despite having previously summarized the survey data on vaccine acceptance, I neglected to realize just how low it would continue to be. I also forecasted 200,000 new confirmed cases per day, but they have since dropped drastically.
Severity: Moderate/Low. I didn’t account for low vaccine acceptance, or the lack of a vaccine for children. I did note that daily confirmed cases was my lowest confidence assumption.
Response: None.

Age of Top YC Founders

Post: Replying to Robert Wiblin on Young Rationalists
Type: Factual error.
Summary: I got a couple ages wrong in the original spreadsheet. Mean/median age at founding was previously listed as 26, but is actually 27. Mean/median age in 2020 was listed as 36 and 35, but are actually both 37. Thanks to Gytis Daujotas for catching these.
Severity: Minor. Ages are off by 1 or 2 years, which slightly weakens my argument.
Response: The post and data has been corrected, with the original mistake noted.

This is an evergreen post. It’s linked from the header, and will be updated periodically.

Stat News

Post: Contra StatNews: How Long to Herd Immunity?
Type: Factual errors.
Summary: A Stat article forecasting time to herd immunity misrepresents basic research findings and contains non-trivial arithmetic errors.
Epistemic Status of Source: High – Stat is widely acclaimed and often featured on Marginal Revolution as an authoritative source.
Attempts to Contact: They have a form for correction requests.
Response: N/A.

Substack

Posts: How Substack Became Milquetoast, The Best Writing Against, For, and On Substack
Type: Abstract theoretical issues.
Summary: Substack’s incentive structure enforces homogeneity.
Response: Nadia Eghbal (Head of Writer Experience) replied here.
Notes: Substack did later change their leaderboard, though probably not in response to my writing.

Lambda School

Posts: Austen Allred is Consistently Deceptive, Lambda School’s Incredibly Naive Incentive Alignment, Correlated Returns are Insufficient for True Alignment
Type: Factual errors, abstract theoretical issues and misleading statements.
Summary: Lambda School’s CEO has repeatedly lied about student outcomes and misrepresented legal action against the company. Their incentive alignment is not theoretically sound.
Epistemic Status of Source: Low – I cite podcasts, tweets and forum comments from Allred. Startup founders are already notoriously dishonest.
Attempts to Contact: Email to Lambda School Chief of Staff.
Response: N/A.
Notes: I later clarified that despite its flaws, Lambda School is not necessarily inferior to a 4-year college degree.

Walter Issacson on Leonardo da Vinci’s Mathematical Ability

Post: Beware the Casual Polymath
Type: Factual error.
Summary: Issacson claims that da Vinci found a solution to the Delian problem. He details an incorrect solution. Further investigation reveals several other incorrect solutions by da Vinci, and no correct ones. Correct solutions discovered by mathematicians do not match Issacson’s description.
Epistemic Status of Source: Medium – It’s a pop-history book, albeit a very popular one.
Response: N/A.