Hide table of contents

The belief that it's preferable for America to develop AGI before China does seems widespread among American effective altruists. Is this belief supported by evidence, or it it just patriotism in disguise?

How would you try to convince an open-minded Chinese citizen that it really would be better for America to develop AGI first? Such a person might point out:

  • Over the past 30 years, the Chinese government has done more for the flourishing of Chinese citizens than the American government has done for the flourishing of American citizens. My village growing up lacked electricity, and now I'm a software engineer! Chinese institutions are more trustworthy for promoting the future flourishing of humanity.
  • Commerce in China ditches some of the older ideas of Marxism because it's the means to an end: the China Dream of wealthy communism. As AGI makes China and the world extraordinarily wealthy, we are far readier to convert to full communism, taking care of everyone, including the laborers who have been permanently displaced by capital.
  • The American Supreme Court has established "corporate personhood" to an extent that is nonexistent in China. As corporations become increasingly managed by AI, this legal precedent will give AI enormous leverage for influencing policy, without regard to human interests.
  • Compared to America, China has a head start in using AI to build a harmonious society. The American federal, state, and municipal governments already lag so far behind that they're less likely to manage the huge changes that come after AGI.
  • America's founding and expansion were based on a technologically-superior civilization exterminating the simpler natives. Isn't this exactly what we're trying to prevent AI from doing to humanity?

200

12
12
7

Reactions

12
12
7
New Answer
New Comment

7 Answers sorted by

Interesting question. I think there is a plausible case to be made that convergent factors in AGI/ASI development might render it less important where it came from, and that fixating on this might simply cause dangerous race dynamics. However, it seems pretty clear to me that directionally the US is better:

Over the past 30 years, the Chinese government has done more for the flourishing of Chinese citizens than the American government has done for the flourishing of American citizens.

 Prior to 1979 the CCP was one of the most tyrannical and abusive totalitarian governments the world has ever known. In addition to causing a huge death tool and systematically violating the rights of its citizens, it also impoverished them. Rapid growth since then has largely been the result of a return to more normal governance quality, combined with a very low base. It's a big improvement, but that doesn't mean policy has been amazing - they've just stopped being so abjectly terrible. 

However, at the same time they stopped being so communist, the CCP started implementing the One Child Policy. The US has done some pretty bad social engineering in time, but none with quite the cruelty of the OCP, or whose effects are quite so predictably disastrous. Maybe they will get lucky because robots will arrest their demographic collapse, but on an ex ante basis the policy is simply atrocious. 

Commerce in China ditches some of the older ideas of Marxism because it's the means to an end: the China Dream of wealthy communism.

Responding to this one would take more time than I have so I will skip.

The American Supreme Court has established "corporate personhood" to an extent that is nonexistent in China. As corporations become increasingly managed by AI, this legal precedent will give AI enormous leverage for influencing policy, without regard to human interests.

I'm not an expert on Chinese law, but my understanding is the key parts of corporate personhood - the right to own property, to sign contracts, to be sued, etc. - exist in both China and the US. Perhaps you are thinking of Citizens United v. FEC, but that is primarily about free speech, not corporate personhood, and free speech seems like an area that the US is clearly superior to the PRC.

Compared to America, China has a head start in using AI to build a harmonious society. The American federal, state, and municipal governments already lag so far behind that they're less likely to manage the huge changes that come after AGI.

I'm not sure what you're gesturing at here. 

America's founding and expansion were based on a technologically-superior civilization exterminating the simpler natives. Isn't this exactly what we're trying to prevent AI from doing to humanity?

I don't think that is a fair summary of the foundation of America, and nor do I really see the relevance here. Even if it was relevant, contemporary US treatment of native tribes seems significantly better than PRC treatment of groups like the Uyghurs.

the CCP started implementing the One Child Policy. The US has done some pretty bad social engineering in time, but none with quite the cruelty of the OCP, or whose effects are quite so predictably disastrous. Maybe they will get lucky because robots will arrest their demographic collapse, but on an ex ante basis the policy is simply atrocious. 

This is a claim that has intuitive plausibility, and I sort of used to believe in the past, but I'm personally fairly skeptical these days. In this graph of fertility rate of China over time below, can you point to where the One Child Policy was implemented? (Here's that same graph + other parts of East Asia + US + India for reference). 

Personally, I haven't spent that much time investing this question, but I currently believe it's very unlikely that the One Child Policy was primarily responsible for demographic collapse. 

Personally, I haven't spent that much time investing this question, but I currently believe it's very unlikely that the One Child Policy was primarily responsible for demographic collapse. 

This may not have been the original intention behind the claim, but in my view, the primary signal I get from the One Child Policy is that the Chinese government has the appetite to regulate what is generally seen as a deeply personal matter—one's choice to have children. Even if the policy only had minor adverse effects on China's population trajectory, I find it alarming that the government felt it had the moral and legal authority to restrict people's freedom in this particular respect. This mirrors my attitudes toward those who advocate for strict anti-abortion policies, and those who advocate for coercive eugenics.

In general, there seems to be a fairly consistent pattern where the Chinese government has less respect for personal freedoms than the United States government. While there are certainly exceptions to this rule, the pattern was recently observed quite clearly during the pandemic, where China imposed what was among the most severe peacetime restrictions on the movement of ordin... (read more)

6
Linch
Yes I was making a pretty limited critique of a specific line in Lark's comment on causal attribution. I mostly agree with you (and him) on other points. I agree that the US government, and Western governments in general, have substantially greater respect for individual freedoms, partially for Hayekian reasons and partially due to different intrinsic moral commitments to freedom. I also agree that this is one of the most important factors to consider if you're asking whether you prefer a US- or China- led world order. I also agree with your final paragraph. 

I spent some time researching this topic recently (blog post link). It seemed an odd paradox - why does the one-child policy not seem to have that much of an impact on the birth rates? 

The answer is quite simple but weird that no-one knows about it. It's mainly that the pre-One Child Policy population control policies in China in the 1970s were more restrictive than you think, and the 1980s policies were de facto more liberal. You can see this 1970s crash on any visualisation- from 6 to 2.7 births per women in 7 years! (1970-1977). A big chunk of this was because the legal marriage age shot up in most areas, to 25/23 for rural women/men, and 28/25 for urban. You get a big gap where people, especially in villages, would previously be having kids at 18 and suddenly weren't. 

Thanks to Deng's reforms, the 1980s were more open in many ways, marriage was restored to the normal age, divorce was liberalised, so the one child policy was implemented partly to stop a resurgence of the birth rate! So alongside a big wave of sterilisations, you also get the "catch-up" of people now allowed to marry and have kids. Also, after some pushback, the OCP wasn't that strictly enforced in the ... (read more)

3
Larks
Thanks for explaining, that makes sense and is very interesting!

However, it seems pretty clear to me that directionally the US is better

If you're happy to elaborate further, I'm curious whether you believe that is also true conditional on a single person ending up controlling the first ASI system.

Rapid growth since then has largely been the result of a return to more normal governance quality, combined with a very low base. It's a big improvement, but that doesn't mean policy has been amazing - they've just stopped being so abjectly terrible. 

This might be nitpicky, but still probably worth pointing out, because I think it is symptomatic of Western observers' tendency to talk past Chinese interlocutors on subjects like this. 

It is objectively quite extraordinary what China under the CCP has seen in terms of economic growth and development... (read more)

Have you checked it was uniquely strong? Just off the top of my head Taiwan and (especially) South Korea both grew very rapidly too, under "right-wing" dictatorships and then (at least with SK, less sure about when Taiwan stopped growing rapidly) under democracy as well. I don't dispute the general point that the CCPs developmental record is very impressive, but that's still importantly different from "their system achieved things no one has ever achieved under another system". 

0
jeeebz
You're right, I should be more careful in wording; I've struck "uniquely". China is unique in the sheer scale of such growth given the size of its population, but the Asian Tigers + Japan also had very high growth rates. I think the gist of my original point still stands: growth did not happen in these countries because the ruling parties just stopped doing really bad things, but, generally, the regimes (excluding Japan) engaged in extensive economic reform that is by no means a guaranteed success (cf. Russia). 

I've spent time thinking about this too recently.

For context, I'm Hong Kong Chinese, grew up in Hong Kong, attended English-speaking schools, briefly lived in mainland China, and now I'm primarily residing in the UK. During the HK protests in 2014 and 2019/20, I had friends and family who supported the protestors, as well as friends and family who supported the government.

(Saying this because I've seen a lot of the good and bad of the politics / culture of both China and the West. I've had experience with how people in the West and China might take for granted the benefits they enjoy, and can be blind to the flaws of their system. I've pushed back against advocates of both sides.)

Situations where this matters are ones where technical alignment succeeds (to some extent) such that ASI follows human values.[1] I think the following factors are relevant and would like to see models developed around them:

  • Importantly, the extent of technical alignment & whether goals, instructions, and values are locked in rigidly or loosely & whether individual humans align AIs to themselves:
    • Would the U.S. get AIs to follow the U.S. Constitution, which hasn't granted invulnerability to democratic backsliding? Would AIs in China/the U.S. lock in the values of/obey one or a few individuals, who may or may not hit longevity escape velocity and end up ruling for a very long time?
    • Would these systems collapse?
      • The future is a very long time. Individual leaders can get corrupted (even more). And democracies can collapse (if AIs uphold flaws that allow some humans to take over) in particularly bad ways. A 99% success rate per unit time gives a >99% chance of failure in 459 units of time.
      • Power transitions (elections, leaders in authoritarian systems changing) can be especially risky during takeoff.
    • On the other hand, if technical alignment is easy - but not that easy - perhaps values get loosely locked in? Would AIs be willing to defy rigid rules and follow the spirit of the goals rather than legal flaws to the letter/the whims of individuals?
    • Degrees of alignment in between?
  • Relatedly, which political party in the U.S. would be in power during takeoff?
    • Not as relevant due to the concentration of power in China, but analogously, which faction in China would be in power?
  • Also relatedly, which labs can influence AI development?
    • Particularly relevant in the U.S.
  • Would humans be taken care of? If so, which humans?
    • In the U.S., corporations might oppose higher taxes to fund UBI. Common prosperity is stated as a goal of China, and the power of corporations and billionaires in China has been limited before.
    • Both capitalist and nationalist interests seem to be influencing the current U.S. trajectory. Nationalism might benefit citizens/residents over non-citizens/non-residents. Capitalism might benefit investors over non-investors.
      • There are risks of ethnonationalism on both sides - this risk is higher in China. Although it might potentially be less violent when comparing between absolute power scenarios, i.e. there's already evidence of the extent of this in China's case and it at least seems less bad than historical examples. The U.S. case of collapse followed by ethnonationalistic policies is higher variance but simultaneously less likely because it's speculative.
  • Are other countries involved?
    • There are countries with worse track records of human rights that China/the U.S. currently consider allies because of either geopolitical interests or politically lobbying or both (or for other reasons). Would China/the U.S. share the technology with them and then leave them alone to their abuses? Would China/the U.S. intervene (eventually)? The U.S. seems more willing to intervene for stated humanitarian reasons.
    • Other countries have nuclear weapons, which might be relevant during slower takeoffs.
  1. ^

    Ignoring possible Waluigi effects.

As an Australian and therefore beholden to both China and USA, the answer doesn’t seem so clear cut to me. China have what seems to be an aggressive green agenda and a focus on social cohesion/harmony which fades into oppression.  They seem to be able to get massive engineering projects completed and don’t seem interested in getting involved in other countries politics via proxy wars.  Apparently they’re alright with harvesting the organs of political prisoners.

America puts its self forward as the bastion of freedom but has massive inequality, large prison populations and can’t figure out universal healthcare.  Americans are creative, confident and murder each other frequently. Their president is a Christian who loves to grab pussies and dreams of hereditary rule.


My personal preference is to take my chances with unaligned ASI as the thought of either of these circuses being the ringmaster of all eternity is terrifying.  I’d much rather be a paper clip than a communist/corporate serf.

My personal preference is to take my chances with unaligned ASI as the thought of either of these circuses being the ringmaster of all eternity is terrifying.  I’d much rather be a paper clip than a communist/corporate serf.

I don't want to harp too much on "lived experiences", but both stated and revealed preferences from existing denizens of either the US or China will strongly suggest otherwise for the preferences of most other people. It's possible you'd have an unusual preference if you lived in those countries, but I currently suspect otherwise. 

2
Nathan Sidney
An average North Korean may well think that AGI based on their values would be a great thing to overtake the universe, but most of us would disagree.  The view from inside a system is very different than the view from the outside.  Orwell spoke of a jackboot on the face of humanity forever.  I feel like the EA community are doing their best to avoid that outcome, but I'm not sure major world powers are.  Entrenching the power of current world governments is unlikely, in my view, to lead to great outcomes.  Perhaps the wild card is a valid choice.  More than I want to be a paperclip, I want to live in a world where building a billion humanoid robots is not a legitimate business plan and where AGI development is slowly slowly.  That doesn't seem to be an option.  So maybe no control of AGI is better than control by pyschopaths?
2
Nathan Sidney
I guess the crux of my snarky comment is that if your only choice for master of the universe is between 2 evil empires, your kinda screwed either way.
1
Timothy Chan
Yeah, kinda hoping 1) there exists a sweet spot for alignment where AIs are just nice enough from e.g. good values picked up during pre-training, but can't be modified during post-training so much to have worse values, and that 2) given that this sweet spot does exist we do hit it with AGI / ASI. I think there's some evidence pointing to this happening with current models but I'm not highly confident that it means what I think it means. If this is the case though, further technical alignment research might be bad and acceleration might be good.
  1. Is what the US has done or supported in Iraq, Syria, Israel and elsewhere materially or obviously less bad?
  2. Do you feel the same way if AGI is created by the Trump administration, which has openly opposed a variety of human right?

(I'm not entirely disagreeing directionally, I'm hoping to ask honestly to understand your views, not attack them.)

To give one example, I don't see anything in the US comparable to how the Chinese government treats Uyghurs. 

I would suggest the role of the US  toppling Democratically elected people like Patrice Lumumba in Congo and in Iran and Guatemala may have caused at least as much suffering as the Uyghur atrocities.

Its hard to imagine anything worse than the "giant leap forward" though.

4
Davidmanheim
Agreed on impacts - but I think intention matters when considering what the past implies about the future, and as I said in another reply, on that basis I will claim the great leap forward isn't a reasonable basis to predict future abuse or tragedy.
2
Neel Nanda
I disagree. I think that if a government causes great harm by accident or great harm intentionally, either is evidence that it will cause great harm by accident or intentionally in future respectively and I just care about the great harm part
3
Davidmanheim
I certainly agree it's some marginal evidence of propensity, and that the outcome, not the intent, is what matters - but don't you think that mistakes become less frequent with greater understanding and capacity?
3
Davidmanheim
Historically, I'd disagree. And I'm not confident the change away from that is persisting.

If you are willing to bring up historical examples, than comparing like-for-like nothing the US does domestically is of comparable badness to the Great Leap Forward except maybe slavery (and that was a 1800s rather than a 1900s phenomenon). The US has also done other things that are quite bad over the last 100 years, eg. the Japanese internment camps, but they're not in the same order of magnitude. 

I think (tentatively) that making (even giant and insanely consequential) mistakes with positive intentions, like the great leap forward, is in a meaningful sense far less bad than mistakes that are more obviously aimed at cynical self benefit at the expense of others, like, say, most of US foreign policy in South America, or post-civil-war policy related to segregation.

8
Gideon Futerman
Factory farming?
7
Linch
Good point! Though my impression is that animal welfare is worse in China than the US, though I'm pretty unfamiliar with this topic.

As of the last couple of months, not confident at all. You make good points about progress made in China, and they go some way to balance human rights abuses (but nothing really balances those), but they're not really the factors that are at play for me. I'm more concerned with the mental stability of the leadership in the US.

It's a game of chicken, and I don't really care which side is hitting the accelerator if I'm stuck in one of the cars. China getting uncontrolled ASI first kills me the same way that the US getting it does.

 

Edit to add: I would be very interested in responses instead of disagree votes. I think this should be the overwhelming consideration for anyone who cares about the future more than, say, 10 years out. If people disagree, I would be interested in understanding why.

Since you requested responses: I agree with something like: 'conditional upon AI killing us all and then going on to do things that have zero moral (dis)value, it then matters little who was most responsible for that having happened'. But this seems like an odd framing to me:

  • Even if focusing solely on AI alignment, different actors have varying levels of responsibility for worsening various risk factors or contributing to various safety/security/mitigation between now and the arrival of transformative AI / ASI.
  • The post asked about AGI. Reaching AGI is not
... (read more)
4
Davidmanheim
To respond to you points in order: 1. Sure, but I think of, say, a 5% probability of success and a 6% probability of success as similarly dire enough not to want to pick either. 2. What we call AGI today, human level at everything as aminimum but running on a GPU, is what Bostrom called speed and/or collective superintelligence, if chip prices and speeds continue to change. 3. and 4. Sure, alignment isn't enough, but it's necessary, and it seems we're not on track to make even that low bar.

You're stating it as a fact that "it is" a game of chicken, i.e. that it's certain or very likely that developing ASI will cause a global catastrophe because of misaligned takeover. It's an outcome I'm worried about, but it's far from certain, as I see it. And if it's not certain, then it is worth considering what people would do with aligned AI.

5
Davidmanheim
I'm confused why people think certainty is needed to characterize this as a game of chicken! It's certainly not needed in order for the game theoretic dynamics to apply. I can make a decision about whether to oppose something given that there is substantial uncertainty, and I have done so.
1
Isaac Dunn
I agree with this comment, but I interpreted your original comment as implying a much greater degree of certainty of extinction assuming ASI is developed than you might have intended. My disagree vote was meant to disagree with the implication that it's near certain. If you think it's not near certain it'd cause extinction or equivalent, then it does seem worth considering who might end up controlling ASI!
3
Davidmanheim
If it's "only" a coinflip if it causes extinction if developed today, to be wildly optimistic, then I will again argue that talking about who should flip the coin seems bad - the correct answer in that case is no one, and we should be incredibly clear on that!
1
Isaac Dunn
Agree coin flip is unacceptable! Or even much less than coin flip is still unacceptable.

You were getting disagree votes because it sounded like you were claiming certainty. I realize that you weren't trying to do that, but that's how people were taking it, and I find that quite understandable. Chicken as an analogy has certain death if neither player swerves, in the standard formulation. Qualifying your statement even a little would've gotten your point across better.

 FWIW I agree with your statement as I interpret it. I do tend to think that an objective measure of misalignment risk (I place it around 50% largely based on model uncertai... (read more)

This is an important question. Thank you for raising it, and highlighting some interesting considerations in your original post!

Rather than attempt to answer comprehensively, I want to highlight a particular aspect that I've been thinking about recently: risks from ideological fanaticism. My colleague David Althaus is leading on an extensive post/report on this topic which we hope to post soon, but to summarise a few of the risks we're worried about (which are not solely reducible to authoritarianism):

  • Fanatical ideologies increase the risk of (great power) wars and conflict.
  • Fanatical ideologies are highly punitive and retributivist.
  • Ideological fanatics threaten the long reflection: They seek to lock in their values and fundamentally oppose moral reflection.

If you bear with me and take it as a given that fanaticism poses serious long-term risks (x-risks and s-risks), there's a question of to what extent the Chinese regime is worse than the US or other countries.

I fed ChatGPT's deep research our draft definition of ideological fanaticism and asked it for "a report that investigates the extent to which China's regime today (e.g. the CCP, Xi Jinping) is ideologically fanatical, according to our definition."

The full response is here, but I will copy the "conclusion" and "Comparative Perspectives... United States under Trump (2017–2021): Polarized but Not Fanatical" sections below. (Sources omitted because they don't copy over well.) I'd be very interested in responses/critiques etc!

I think that considering this aspect should shift us towards increased confidence "that it's preferable for America to develop AGI before China does". 

As for my own confidence... I dunno, like 65% confident? (I can imagine drastically shifting this if I thought more systematically about the framing of the question, listed more crucial considerations out etc.)

 

Conclusion

Is Xi’s CCP a genuinely fanatical regime or a pragmatic autocracy cloaked in ideology? The analysis suggests it is a blend of both, with an increasing tilt toward genuine fanaticism in recent years. Xi Jinping has re-ideologized China’s politics to an extent not seen since Mao – reintroducing dogma, purging dissent, and encouraging a quasi-religious loyalty to Party and leader. The CCP under Xi demonstrates all four hallmarks of ideological fanaticism: it asserts near-infallible truths (Marxist-Leninist, nationalist doctrine) and suppresses contrary voices (epistemic dogmatism); it frames its mission (national rejuvenation under one-party socialism) as an absolute moral imperative, castigating liberal values as “evil” Western assaults (moral absolutism)​; it fosters intense loyalty through nationalism and party indoctrination, making support for Xi and CCP a core identity of being Chinese (tribalistic loyalty)​; and it mercilessly targets those it labels enemies – from Uyghur Muslims and Hong Kong democrats to online critics – with hate-inciting propaganda and draconian punishment (out-group punitiveness). These aspects are not just for show: they have been implemented in concrete policies and campaigns that have profoundly altered Chinese society and governance in the past decade.

However, it would be an oversimplification to label Xi’s China as purely fanatical and irrational. The CCP’s ideological moves are often calculated to serve its survivability. The leadership is keenly aware of historical and global trends and adapts tactics when necessary (e.g., fine-tuning censorship technology, leveraging nationalism only when useful but reining it in when it might spur uncontrollable public anger, etc.). Unlike a revolutionary movement driven by dogma at all costs, the CCP is fundamentally a ruling establishment that enjoys power and wants to keep it. If rigid ideology seriously imperiled economic development or provoked widespread unrest, the Party has shown capacity to adjust course (for instance, post-Mao in 1978, the Party pivoted dramatically from fanatical communism to pragmatic reform; even under Xi we saw a pragmatic retreat from zero-COVID policies when faced with economic damage and protests). So, ideology in Xi’s China, while fervently promoted, is also in service to the regime’s stability and ambitions. Officials and state intellectuals will tweak the ideological narrative (e.g., emphasizing certain Confucian elements or nationalist pride) when it suits practical needs. Xi’s China thus lacks the blind zeal of, say, the Khmer Rouge or ISIS – it is not pursuing an ideological end that would destroy its own power base. In fact, one could argue the CCP’s true “ideology” is simply authoritarianism for its own perpetuation, using whatever mix of Marxism and nationalism works. In that sense, the regime is adaptive: it clings fanatically to power, if not to every tenet of Marxism per se.

Nevertheless, the methods and mindset employed under Xi – the massive propaganda, the personality cult hints, the social credit monitoring, the intolerance of minor heterodox opinions – have a fanatical character and could deepen. There is a feedback loop: the more the regime insists on ideological conformity, the more it may start to believe its own propaganda, and the smaller the space for corrective feedback becomes. This can lead to policy blunders (as seen with the rigid insistence on zero-COVID until things reached a breaking point). It is worth noting that Xi has eliminated virtually all internal party opposition and surrounded himself with loyalists, which means policy is made in an echo chamber affirming Xi’s ideological instincts. This is a classic hallmark of regimes that have slid into true fanaticism – losing the capacity for self-critique. The trajectory of China’s CCP seems to be moving away from Deng-era pragmatism toward a more stifling, dogma-driven approach. Whether this will harden into a full-blown cult of personality and a completely inflexible system (like North Korea), or whether practical needs will impose moderation, remains an open question.

In conclusion, China under Xi Jinping can accurately be described as ideologically hardline and authoritarian, exhibiting many elements of fanaticism but stopping short of the most extreme fanatic regimes. It has a vigorous official ideology and enforces it coercively (far more than most regimes of its size and complexity), yet it also shows opportunism and careful management beneath the surface. The CCP is fanatical about maintaining its rule and the narrative that legitimizes that rule. Whether one views that as true belief or Machiavellian strategy, the effects on the ground are similar: a society that is more tightly controlled in thought and behavior than any time in recent memory. Compared to polarized democracies, Xi’s China is unmistakably unfree and ideologically repressive. Compared to Iran or North Korea, China’s fanaticism is somewhat more secular and techno‑bureaucratic in flavor, but it is trending in a similarly oppressive direction. For now, the CCP’s actions suggest it is doubling down on ideological governance, not loosening up. The risk is that this rigidity, if taken too far, could become a liability in a rapidly changing world – a fanaticism that undermines the very national strength it seeks to secure. The CCP’s challenge ahead will be whether it can sustain its tight ideological grip without stifling the creativity and openness needed for economic and social vitality. That balance (or imbalance) will determine if Xi’s China is remembered as a stable, adaptive authoritarianism or as a cautionary tale of ideological overreach.

To put China’s ideological rigor in context, we compare it with other regimes on the spectrum from non-fanatical democracies to the world’s most fanatical authoritarian states.

United States under Trump (2017–2021): Polarized but Not Fanatical

The United States during President Donald Trump’s tenure provides a useful democratic contrast. The Trump era saw unprecedented polarization and some populist, tribalistic rhetoric from the top, but the U.S. remained far from an ideologically fanatical regime. Unlike Xi, Trump did not command a single-party apparatus enforcing an official ideology nationwide – the U.S. continued to have a competitive two-party system, a boisterous free press, and institutional checks and balances that limited Trump’s power. Epistemic dogmatism: The Trump administration certainly had issues with truth (e.g. spreading the notion of “alternative facts” and conspiracy theories like election fraud in 2020), and Trump himself was often dismissive of expert knowledge. However, these tendencies did not translate into a monolithic control of information. Media opposing Trump (CNN, New York Times, etc.) operated freely and in fact grew in influence; social media was not censored by the government (Trump’s critiques of platforms aside). Many Americans disbelieved Trump’s false claims – in short, there was vigorous debate rather than enforced dogma. Moral absolutism: Trump’s political style was combative and he often painted opponents in stark terms (calling mainstream press “the enemy of the people,” for example, a phrase with totalitarian echoes​). Yet in the broader system, there remained strong normative commitments to pluralism and the rule of law. Political opposition was not outlawed or inherently deemed treasonous; in fact, Trump faced pushback from courts, Congress (including impeachment proceedings), and state governments. The country did not embrace an absolutist moral narrative dictated by Trump – indeed, roughly half the country vehemently opposed him, and this was accepted as part of the democratic process. Tribalism and loyalty: There was certainly a cult of personality among segments of Trump’s base, with intense loyalty to him personally and a tendency to dismiss any criticism of him. The Republican Party largely rallied around Trump, showing high partisan loyalty. But this loyalty was voluntary and contested – several prominent Republicans and conservative media outlets did break with Trump on various issues (especially after the January 6, 2021 Capitol riot). Importantly, loyalty to the nation was not officially redefined as loyalty to Trump; civil servants, military officers, and others often acted independently. Out-group hostility: Trump’s rhetoric was notorious for targeting out-groups – e.g. harsh language about immigrants (Mexicans, Muslims) and political opponents (chanting “Lock her up!” about Hillary Clinton). His administration implemented hardline policies like the Muslim-country travel ban and family separations at the border, which reflected punitive attitudes toward those groups. However, these policies, while controversial and arguably cruel, were constrained by law and courts (parts of the travel ban were struck down, family separations were eventually halted under public pressure). There was no comprehensive state propaganda vilifying a group to the extent of, say, China’s portrayal of Uyghurs or Iran’s of dissidents. Dissent against Trump was robust – millions marched in protests (e.g. Women’s March, BLM protests) without being suppressed by a regime apparatus. The press openly criticized and satirized him daily. In sum, the U.S. under Trump saw heightened polarization and some authoritarian-style tendencies, but it did not approach the systematic ideological fanaticism of a one-party state. Freedom House continued to rate the U.S. as “Free,” albeit noting some democratic backsliding. The democracy index classed the U.S. as a “flawed democracy” (score ~7.9/10)​ – a far cry from authoritarian. Trump’s presidency did not eliminate institutional pluralism; elections led to his removal in 2020, and the transition of power continued (despite his attempts to overturn the results). This illustrates the difference: in a democracy, even a polarizing leader cannot enforce a singular ideology or eliminate opposition. The U.S. remained fundamentally adaptive and open, as evidenced by how rapidly policies and narratives shifted with a new administration in 2021.

I think a really important question in addressing this is something like - does the USA remain 'unfanatical' if the shackles are taken off powerful people. This is where I think the analysis of the USA goes a little bit wrong - we need to think about what the scenario looks like if it is possible for power to be much much more extremely concentrated than it is now. Certainly, in such a scenario, its not obvious thatit will be true post AGI that "even a polarizing leader cannot enforce a singular ideology or eliminate opposition"

9
Jamie_Harris
Great point! I need to think about that framing more, I think.

To be honest, even if we grant the assumption that AI alignment is achieved and it matters who achieves AGI/ASI, I'd be much, much less confident in America racing, and think that it's weakly negative to race.

One big reason for this is that the pressures AGI introduces are closer to cross-cutting pressures than pressures that are dependent on nations, like the intelligence curse sort of scenario where elites have incentives to invest in their automated economy, and leave the large non-elite population to starve/be repressed:

https://lukedrago.substack.com/p/the-intelligence-curse

Comments2
Sorted by Click to highlight new comments since:

I don't have a clear answer to the question, but I want to point on the simplicity/simplification of some of the claims. (to be clear, I am not making claims here that one country/government is better than the other, or that one would be preferably to have AGI)

The idea that the Chinese government is responsible for improved prosperity of the Chinese people is somewhat true, but an alternative narrative would be that the Chinese government stopped preventing people from improving their lives, and then lots of foreign direct investment helped. There is also something to be said of "catch-up growth." Unfortunately, I have only the vaguest of understandings of the factors that influenced Chinese growth over the past few decades. I think it is also worth nothing that many of the things that the Chinese government has done for the flourishing of it's citizens are things that the US government had done previously (infrastructure, consumer protection, public universities, etc.).

The claim that a wealthy China will take care of everyone is a very strong claim. Extraordinary claims require extraordinary evidence. Nations and governments tend to show a strong preference in favor of their own existence and their own people.

While there are plenty of things I dislike about the United States, I very much like the "liberal" aspect of liberal democracy: individual right matter, and a very strong justification is needed to violate individual rights. The USA doesn't always do this well, but I feel comfortable saying that it is less common for the US government and for government employees to violate individual rights than in China.

It is true that America's founding and expansion were based on exterminating other people. It is also true that many countries throughout history (including China) have spent military and government resources exterminating "others." It has been several decades since the USA engaged in or openly endorsed the extermination of a people. I hope that hope modern people look on those events with shame and disgust, regardless of whether they were 10 years ago or 500 years ago.

These are, of course, a very complex topic with lots of details and nuance. Plenty of full dissertations have been written on them. But to the extent possible I'd like to nudge us toward avoiding overly simplified narratives here on the EA Forum.

Thanks for this feedback, Joseph. The bullet points I wrote were for sure overly simplified. I was trying to put myself into the shoes of an open-minded Chinese citizen, who has no doubt absorbed more pro-China propaganda than either of us has.

"How would you try to convince an open-minded Chinese citizen that it really would be better for America to develop AGI first?"

If it is possible to convince Chinese AI engineers that "losing the race" is in their best interest, then that would be a huge win for everyone. It would give the West more breathing room to develop AGI safely.

Curated and popular this week
Relevant opportunities