Forethought[1] is a new AI macrostrategy research group cofounded by Max Dalton, Will MacAskill, Tom Davidson, and Amrit Sidhu-Brar.
We are trying to figure out how to navigate the (potentially rapid) transition to a world with superintelligent AI systems. We aim to tackle the most important questions we can find, unrestricted by the current Overton window.
More details on our website.
Why we exist
We think that AGI might come soon (say, modal timelines to mostly-automated AI R&D in the next 2-8 years), and might significantly accelerate technological progress, leading to many different challenges. We don’t yet have a good understanding of what this change might look like or how to navigate it. Society is not prepared.
Moreover, we want the world to not just avoid catastrophe: we want to reach a really great future. We think about what this might be like (incorporating moral uncertainty), and what we can do, now, to build towards a good future.
Like all projects, this started out with a plethora of Google docs. We ran a series of seminars to explore the ideas further, and that cascaded into an organization.
This area of work feels to us like the early days of EA: we’re exploring unusual, neglected ideas, and finding research progress surprisingly tractable. And while we start out with (literally) galaxy-brained schemes, they often ground out into fairly specific and concrete ideas about what should happen next. Of course, we’re bringing principles like scope sensitivity, impartiality, etc to our thinking, and we think that these issues urgently need more morally dedicated and thoughtful people working on them.
Research
Research agendas
We are currently pursuing the following perspectives:
* Preparing for the intelligence explosion: If AI drives explosive growth there will be an enormous number of challenges we have to face. In addition to misalignment risk and biorisk, this potentially includes: how to govern the development of new weapons of mass destr
Humans are just more important. If you disagree, how many chickens would you trade your mother's life for?
This feels right to say, but open to arguments against it.
The only context for me where it would make more sense to spend it on AW, would be if somehow the ripple effect from doing so would benefit humans more than investing it directly into global health.
Maybe by improving nutrition, or improving global morals by not allowing other living beings to suffer, or just having a clear conscience.
I'm not saying an animal suffering is right or acceptable, but it comes second, and will always come second to me, at least while human suffering is still so so high.
Thanks for the detailed reply!
You’re right it was a provocative question trying to cut to the chase.
But here’s the thing, probably every single person has people close to them that they consider family. So yeah a random stranger would be less important to ME than my own mother, but that person also has someone that cares for them like I would for my mother. How do you explain to them that their life was sacrificed for x amount of chicken?
I guess for me, there is no amount of farmed animals that’s worth a human life. For as long as investing in animal welfa... (read more)