Hide table of contents

Stampy’s AI Safety Info is an interactive FAQ started by Rob Miles that aims to be the best one-stop source of information about AI existential safety, gathering summaries and links on each of hundreds of subtopics.

Now that the first fellowship is nearing an end, we’re preparing for a second distillation fellowship from July 3rd through October 2nd. Distillation fellows will be working with each other and with me to improve the site further by editing the existing answers and writing new ones. They’ll be paid $2500 per month for three months working full-time as remote contractors. (Partial fellowships will probably be possible as well.) We’ll have at least five spots for fellows, and maybe more.

We’re also announcing a hackathon-style event, which we’re organizing together with Apart Research, on the 16th17th, and 18th of June. People are invited to write and edit articles during whichever parts of those days best fit their schedules. (If you’re unable to attend on those days, you can still participate by choosing another contiguous three-day period between now and the event—for example, next weekend—to write all your entries in.)

Collaboration on the event will take place on Discord as well as on gather.town. I’ll be online for those three days to lead the event and answer any questions. We encourage people to work together on entries during that time, but we encourage one individual to be in charge of each entry.[1]

Submitting good articles and helping other people write their articles in the write-a-thon will be the main criteria we’ll use to select distillation fellows. There will also be prize money for the best entries: $1000, $600, $300, and $100 for the best four, and $200 for one randomly chosen (serious) entry.

We will have a more specific list of suggested questions to use for entries later, but for now, you can look at the “Not started” part of Stampy’s list of questions, and take a look at existing articles and the style guidelines for what an article should look like. (You can also use a new question of your own devising; to make sure you’re not wasting your effort on a question that won't fit on the site, you can ask on Discord or check with me.)

We wanted to put this announcement up without waiting longer, but we’re still finalizing some of the details, so check back in the coming days for further details on submission instructions, an application form, and the like. 

If you want to help out in some other way, AISafety.info welcomes donations (details soon), volunteer editors, and volunteer coders.

If you have questions about the write-a-thon, the fellowship, or anything else, feel free to ask in the comments or message me here or on Discord (StevenK#3458).


(Edit 2023-06-09: See this doc for the most up-to-date information about how to participate and about the schedule. In case any of you want to participate early, it's best to look through that and visit Discord.)

  1. ^

    Keep track of who else was helpful; there will be a rank-ordering question in the application form for who you’d most like to work with. Making a joint entry with multiple people is also possible, but makes it harder to assign credit. 

12

0
0

Reactions

0
0
Comments1


Sorted by Click to highlight new comments since:

Since somebody was wondering if it's still possible to participate without having signed up through alignmentjam.com:

Yes, people are definitely still welcome to participate today and tomorrow, and are invited to head over to Discord to get up to speed.

Curated and popular this week
LewisBollard
 ·  · 6m read
 · 
> Despite the setbacks, I'm hopeful about the technology's future ---------------------------------------- It wasn’t meant to go like this. Alternative protein startups that were once soaring are now struggling. Impact investors who were once everywhere are now absent. Banks that confidently predicted 31% annual growth (UBS) and a 2030 global market worth $88-263B (Credit Suisse) have quietly taken down their predictions. This sucks. For many founders and staff this wasn’t just a job, but a calling — an opportunity to work toward a world free of factory farming. For many investors, it wasn’t just an investment, but a bet on a better future. It’s easy to feel frustrated, disillusioned, and even hopeless. It’s also wrong. There’s still plenty of hope for alternative proteins — just on a longer timeline than the unrealistic ones that were once touted. Here are three trends I’m particularly excited about. Better products People are eating less plant-based meat for many reasons, but the simplest one may just be that they don’t like how they taste. “Taste/texture” was the top reason chosen by Brits for reducing their plant-based meat consumption in a recent survey by Bryant Research. US consumers most disliked the “consistency and texture” of plant-based foods in a survey of shoppers at retailer Kroger.  They’ve got a point. In 2018-21, every food giant, meat company, and two-person startup rushed new products to market with minimal product testing. Indeed, the meat companies’ plant-based offerings were bad enough to inspire conspiracy theories that this was a case of the car companies buying up the streetcars.  Consumers noticed. The Bryant Research survey found that two thirds of Brits agreed with the statement “some plant based meat products or brands taste much worse than others.” In a 2021 taste test, 100 consumers rated all five brands of plant-based nuggets as much worse than chicken-based nuggets on taste, texture, and “overall liking.” One silver lining
 ·  · 2m read
 · 
I can’t recall the last time I read a book in one sitting, but that’s what happened with Moral Ambition by bestselling author Rutger Bregman. I read the German edition, though it’s also available in Dutch (see James Herbert's Quick Take). An English release is slated for May. The book opens with the statement: “The greatest waste of our times is the waste of talent.” From there, Bregman builds a compelling case for privileged individuals to leave their “bullshit jobs” and tackle the world’s most pressing challenges. He weaves together narratives spanning historical movements like abolitionism, suffrage, and civil rights through to contemporary initiatives such as Against Malaria Foundation, Charity Entrepreneurship, LEEP, and the Shrimp Welfare Project. If you’ve been engaged with EA ideas, much of this will sound familiar, but I initially didn’t expect to enjoy the book as much as I did. However, Bregman’s skill as a storyteller and his knack for balancing theory and narrative make Moral Ambition a fascinating read. He reframes EA concepts in a more accessible way, such as replacing “counterfactuals” with the sports acronym “VORP” (Value Over Replacement Player). His use of stories and examples, paired with over 500 footnotes for details, makes the book approachable without sacrificing depth. I had some initial reservations. The book draws heavily on examples from the EA community but rarely engages directly with the movement, mentioning EA mainly in the context of FTX. The final chapter also promotes Bregman’s own initiative, The School for Moral Ambition. However, the school’s values closely align with core EA principles. The ITN framework and pitches for major EA cause areas are in the book, albeit with varying levels of depth. Having finished the book, I can appreciate its approach. Moral Ambition feels like a more pragmatic, less theory-heavy version of EA. The School for Moral Ambition has attracted better-known figures in Germany, such as the political e
 ·  · 6m read
 · 
Cross-posted from Otherwise. Most people in EA won't find these arguments new. Apologies for leaving out animal welfare entirely for the sake of simplicity. Last month, Emma Goldberg wrote a NYT piece contrasting effective altruism with approaches that refuse to quantify meaningful experiences. The piece indicates that effective altruism is creepily numbers-focused. Goldberg asks “what if charity shouldn’t be optimized?” The egalitarian answer Dylan Matthews gives a try at answering a question in the piece: “How can anyone put a numerical value on a holy space” like Notre Dame cathedral? For the $760 million spent restoring the cathedral, he estimates you could prevent 47,500 deaths from malaria. “47,500 people is about five times the population of the town I grew up in. . . . It’s useful to imagine walking down Main Street, stopping at each table at the diner Lou’s, shaking hands with as many people as you can, and telling them, ‘I think you need to die to make a cathedral pretty.’ And then going to the next town over and doing it again, and again, until you’ve told 47,500 people why they have to die.” Who prefers magnificence? Goldstein’s article draws a lot on author Amy Schiller’s plea to focus charity on “magnificence” rather than effectiveness. Some causes “make people’s lives feel meaningful, radiant, sacred. Think nature conservancies, cultural centers and places of worship. These are institutions that lend life its texture and color, and not just bare bones existence.” But US arts funding goes disproportionately to the most expensive projects, with more than half of the funding going to the most expensive 2% of projects. These are typically museums, classical music groups, and performing arts centers. When donors prioritize giving to communities they already have ties to, the money stays in richer communities. Some areas have way more rich people than others. New York City has 119 billionaires; most African countries have none. Unsurprisingly, Schil