Summary

1. I make three arguments against standard difference-making risk aversion that I find compelling as a consequentialist, despite my substantial sympathy for something like difference-making risk aversion:
   1. It privileges a default option, literally as or like an act-omission distinction, or is otherwise unmotivated (more).
   2. It may lead generally to inaction or otherwise favouring the default option, due to multitudes of backfire risks and butterfly effects (more).
   3. It can count against you persuading others to take actions that are less risky from their perspectives, and when the default option is a status quo option, it favours the status quo (more).
   4. Some of these arguments also apply to difference-making ambiguity aversion.
2. I describe multiple versions of or modifications of difference-making views that don't have these problems. Some can also be combined. They are:
   1. use accounts that treat downsides and upsides relative to the fixed default option more symmetrically (more),
   2. statewise sorting, so that we aren’t sensitive to how outcome distributions correspond statewise (more), and
   3. not privileging inaction as the default option to make comparisons with respect to, but potentially treating every option this way (more).
      1. Most of these allow comparisons between two options to depend on whether a third is available (more) and could lend even more support to risky bets like longtermism or on invertebrates than risk neutrality already does (more).

Acknowledgements

Thanks to Derek Shiller, Silvester Kollin and Anthony DiGiovanni for helpful feedback. All errors are my own.

Background

For further background on and discussion of difference-making risk aversion, see Clatterbuck, 2024 and Greaves et al., 2022. I only illustrate briefly here.

If you're risk averse with respect to money, it's better to have a $50 with certainty than a 50% chance of $0 and a 50% chance of $100, even though your expected amount of money is $50 either way.

Suppose we have some quantity for which it is better that its value be higher, like money or total welfare. In economics and according to expected utility theory, this quantity has some utility, captured by an increasing utility function, $u$, of the quantity, and we would pick an option $A$ with maximum expected utility, $E\left[u\right(A\left)\right]$.

On the standard economic and expected utility theory account of risk aversion, $u$ is increasing and concave, i.e. the quantity has diminishing marginal utility.^[1] Examples of such functions are $u\left(x\right)=\sqrt{x}$ for $x\ge 0$, and $u\left(x\right)=1-e^{-x}$.

With diminishing marginal utility, the expected utility of the 50-50 gamble for $100 is lower than the (expected) utility of $50 with certainty:

On the other hand, the standard account of difference-making risk aversion is, for a given choice situation, to fix some default option $D$, e.g. doing nothing or business-as-usual, and compare options $A$ to it, and be risk averse with respect to the difference in outcome "value" between $A$ and $D$. I’ll illustrate.

We again fix some function $u$ that is increasing and concave to capture risk aversion. Then, a specific version of difference-making risk averse falling under the standard account would be to pick the option $A$ that maximizes the following quantity:

where the expected value is taken over the probability distributions over outcomes $A$and $D$. Taking $A=D$ itself will sometimes maximize this expected value among available options.

Against standard difference-making

I think the standard version of difference-making risk aversion, in which you hold some default option constant and compare every other to it, is very unattractive (to me) under consequentialism for three reasons.

Privileging a "default option" is incompatible with consequentialism or unmotivated

Picking one option to compare to privileges it, and if that option is an omission or "doing nothing", this makes some kind of an act-omission distinction and tends to favour omissions, all else equal. Consequentialists typically reject act-omission distinctions (Woollard, 2021). If we are concerned only with the (actual or predicted) consequences of the options available to us, inaction is not fundamentally special and worth singling out at a foundational level, whether or not it’s special in practice. Controlling for the consequences of an option, whether it is identified as an action or inaction should have no bearing on how choiceworthy it is, because only the consequences matter.

Privileging the status quo or business-as-usual or any other particular option in a given choice situation from the outset in a fundamental way also seems unmotivated morally for an impartial consequentialist.

A related objection is that difference-making is partly egoistic and not very impartial at all (Greaves et al., 2022). Why should you care about the difference you make relative to some conveniently selected option, rather than just what’s best, or is stochastically dominant?^[2] Indeed, I object to many non-consequentialist views similarly: privileging the avoidance of committing harm, even if committing that harm would lead to better overall consequences, seems to me overly concerned with my own position. Perhaps uncharitably, it seems more like trying to keep my hands clean than impartially respecting the subjective interests at stake. The same seems to apply to privileging inaction for difference-making risk aversion.

Of course, privileging the avoidance of committing harm may lead to better consequences in practice. It could even be that someone who isn’t difference-making risk averse would do better on their original view by becoming difference-making risk averse, independently of the plausibility of difference-making risk aversion. This could be because many consequentialists may fail to appreciate the instrumental value of cooperation and respecting social norms or the particular downsides for other consequentialists in committing harm, and then we end up with some of us committing financial fraud on one of the largest scales in recent history (O’Connell, 2024), and potentially hurting the efforts of effective altruism community.

But this is a practical argument for difference-making risk aversion, and doesn’t seem very compelling to me as an argument that it’s actually morally correct.^[3] There could be better ways to mitigate such risks that don’t involve abandoning a view that seems more likely correct.

Potentially severely favours inaction or the default

Difference-making risk aversion plausibly leads to generally favouring inaction or the default, when you factor in backfire risks, including unknown backfire risks and backfiring butterfly effects.

I suspect almost any intervention EAs support has important and predictable backfire risks. Many are specific to the intervention or cause area. A potentially common one could be what you support funging with risky work.

Even if an act you're considering and the default have the same chance of causing a tornado from butterfly effects, as long as the outcomes with the extra tornado(es) don't correspond statewise between the two acts and assuming tornadoes are harmful, then this will count against your act under difference-making risk aversion.

To illustrate mathematically, consider two options, $D$ for default, and $A$, with states $a$ and $b$, each occurring with probability 50%, and the following corresponding values:

Under difference-making risk aversion, we should prefer $D$, even though the two options have identical payoff distributions. Even increasing the value of $A$ by a small enough amount, we should still prefer $D$, even though $A$ would then stochastically dominate it and have higher direct expected value.

Difference-making risk aversion — compared to risk neutrality — effectively gives less weight to upsides of an action over the worst cases of inaction and more weight to downsides of action under the best cases of inaction.

And including differences between far future impacts or impacts on wild invertebrates could count a lot against many acts, because these impacts can be very large in scale, potentially much larger than the main impacts we’re assessing, in the extreme cases. Evidential symmetry doesn't help if the values of outcomes don't correspond statewise.

Disfavours changing plans

There’s reason to believe diet change, including vegan and reducetarian advocacy and support for animal product substitutes, has huge effects on wild animals, especially wild invertebrates, by increasing or decreasing their populations (e.g. Tomasik, 2019). Depending on your views, this could go in either direction, possibly extremely good, e.g. dramatically increasing the number of good lives and possibly extremely bad, dramatically increasing the number of bad lives.^[4]

If the overall effects of diet change are too risky from your position, because of potentially huge backfire effects on wild animals, but the potential upside for wild animals are also huge, then convincing Open Phil to do less diet change (and more of something else) can backfire for you by losing this huge potential upside. The lost huge potential upside for wild animals from Open Phil’s perspective becomes a huge potential downside relative to inaction from your perspective.

In general, if someone is doing something risky with both huge potential upsides and huge potential downsides from their position, it doesn’t follow that getting them to do something less risky from their position instead is actually good from your position. When considering shifting their risky work to something less risky, the huge potential upsides of their risky work become huge potential downsides from your position.

Similarly, if my current plan is my default option to compare to — rather than doing nothing or because sticking to it is doing nothing —, then I will tend to favour that plan. For example, I may have already decided on what charities to give to and will do that by default. Or I may have even set up recurring donations that will go on without my intervention. Considering options further and intervening to change my plan is an action, not inaction, and is disfavoured. This looks like status quo bias to me.

Difference-making views that can avoid these problems

There are a few difference-making views that can avoid the problems above. They seem more attractive to me. I outline these as modifications of the view I presented above, and some of them can be combined.

More symmetry

Measure the difference both ways and take the difference

When the default option is $D$, we measured the value of an option $A$ relative to it as $d(A,D)$, e.g. $d(A,D)=E\left[u\right(A-D\left)\right]$. Instead, we could also measure the value of the difference treating $A$ as the default option, $d(D,A)$, and take the difference:

and pick whichever option has the highest such value.

In doing so, we consider both the risk of A relative to $D$ and the risk of $D$ relative to A and treat them symmetrically.

Of course, we still privilege $D$, because every comparison involves $D$, but we can combine this with an approach from Not privileging inaction if we wanted to avoid this.

A sigmoidal rather than concave function

Rather than risk aversion and a concave function u, we should instead give less than proportional weight to both upsides and downsides. We can use a utility function $u$ of the difference we make such that $u$ is increasing, $u\left(0\right)=0,u(-x)=-u\left(x\right)$ ($u$ is an odd function), and u is concave above and to the right of 0 (and possibly bounded above and below), but convex below 0 and to the left of 0. The arctan function, a sigmoid function, is a good example:

This approach does not privilege the default option at all in pairwise comparisons with the default option. It is less (or not) fanatical about backfire risks, so doesn't lead to paralysis or bias against changing plans.

It’s also less fanatical in general, and so more likely to support neartermist interventions and disproportionate priority for beings more likely to be sentient, compared to risk neutral views and most other attitudes towards risk.

Bounded utility functions, including sigmoid functions, also seem more rational, i.e. less prone to selecting dominated strategies (St. Jules, 2023).

However, like in the previous subsection, the default option is still privileged because it's used in every comparison.

Statewise sorting

As before, consider two options, $D$ for default, and $A$, with states $a$ and $b$, each occurring with probability 50%, and the following corresponding values:

Under difference-making risk aversion, we should prefer $D$, even though the two options have identical payoff distributions. Even increasing the value of $A$ by a small enough amount, we should still prefer $D$, even though $A$ would then stochastically dominate it and have higher direct expected value.

Instead, we can relabel and sort their states in increasing order of value, in this case with states $c$ and $d$ with probability 50% each:

If we apply our difference-making criterion to $A^{\prime }$ and $D^{\prime }$ instead of directly to $A$ and $D$, we would be indifferent between $A^{\prime }$ and $D^{\prime }$, and we can lift that indifference to $A$ and $D$. If $A$ had instead stochastically dominated $D$, then applying our difference-making criterion to $A^{\prime }$ and $D^{\prime }$ and lifting that to $A$ and $D$ would favour $A$. That is, we choose $A$ to maximize our measure between $A^{\prime }$ and $D^{\prime }$, with $D^{\prime }$ as the default. For example, with $u$ concave, reflecting diminishing marginal utility:

I will call the approach statewise sorting. I outline it more generally and technically in the following footnote.^[5]

This approach will rule out strictly stochastically dominated options. By doing so, it will be sensitive to the welfare of unaffected beings, which may seem odd and counterintuitive, and could support longtermism (Tarsney, 2020, Tarsney, 2023).

To address the dependence on unaffected beings, we could just omit them from consideration in the state’s value before relabeling and sorting the states. After all, we make no difference to them, and we're interested in difference-making here. However, this would no longer respect stochastic dominance with respect to outcomes.

Furthermore, statewise sorting also gives up some of the appeal of difference-making, which we may take to be inherently statewise. We might think the differences we’d make just are statewise differences, so they deserve special treatment. And we might not care about stochastic dominance, because it doesn’t leave us worse off statewise. Only statewise dominance leaves us worse off statewise, and standard difference-making already respects this.

Statewise sorting also still privileges the default option on its own, but we can avoid doing so by combining it with approaches that don’t privilege inaction, described next. But doing so will typically mean allowing violations of the independence of irrelevant alternatives.

Not privileging inaction

Use the random option as the default

Suppose we have $n$ options available to us for consideration, $A_1,\dots ,A_n$. Let $R$ be the option which is to pick option $A_i$ with probability $1/n$. We’ll call $R$ the random option. Then, we’ll make our comparisons treating $R$ as the  “default option”, $D=R$, comparing measures like $d(A,R)$ and $d(B,R)$. Now, no particular option available to us seems especially privileged or favoured.^[6]

Using the random option as the default to compare to can also be motivated independently: if we didn’t yet know any facts about the options available to us other than their number, then no matter which rule we use to pick an option, we should believe we’ll pick each option with probability $1/n$.^[7] The random option is the option we get under ignorance. It is in fact what we would actually do by default under full ignorance about which option is which, unable to even identify the “do nothing” option better than chance.

However, this may be a fairly unusual and contrived hypothetical: we’re practically never in a position of knowing nothing at all about our options, including which is which and especially which is the “do nothing” (or “status quo”) option. The “do nothing” option is (almost?) always obvious to us.

Furthermore, the random option depends on the available options, so whether $A$ beats $B$ could depend on whether or not an option $C$ is also available. Some find this kind of thing counterintuitive, and instead insist on the independence of irrelevant alternatives (IIA): whether $A$ beats $B$ should never depend on whether or not another option $C$ is also available. This view violates IIA.

That being said, I do not find all violations of IIA counterintuitive, as long as I am sufficiently sympathetic to the reason for the violation. In this case, a reason we can offer for the violation of IIA is that what we’d do with no knowledge about which option is which, i.e. the random option, depends on what options are available to us. That has some intuitive appeal to me. On the other hand, the intuitive appeal seems limited, given how unnatural the hypothetical seems to me. And it’s not clear why I should compare to what I’d do with no knowledge about which option is which. It just seems better to me than singling out inaction as a consequentialist.

And violating IIA can be avoided in practice, if and because we use the “do nothing” option as the default, and exactly one such option is practically always available to us.

There are some other concerns related to individuating and counting options, but these seem addressable in principle, although probably using vague standards.^[8][9]

Use the expected value-maximizing or -minimizing option or outcome as the default

Instead of the “do nothing”, “status quo” or random option as the default, we could let the default option be, among those available to us, the one that maximizes expected value without or ignoring difference-making risk aversion, $O_{max}$. Or, the expected value-minimizing option without difference-making risk aversion, $O_{min}$. Or just the best outcome, $o_{best}$, or worst outcome, $o_{worst}$, among those available to us.^[10] So, $D=O_{max},D=O_{min},D=o_{best}$ or $D=o_{worst}$, respectively. Or, we could use the best or worst outcome among all conceivable outcomes, instead of just among those available to us.

When comparing to the maximizing option or best outcome as the default, we might think of the differences relative to it like a weighted net shortfall.

When comparing to the minimizing option or worst outcome as the default, we might think of the differences relative to it as how much better overall we can do than the worst.

We could also combine these, e.g. by adding $d(A,O_{max})+d(A,O_{min})$, and ranking each option $A$ based on this associated value.

These approaches too will violate the independence of irrelevant alternatives as long as the (or an) option or outcome chosen as default is selected from those available to us, but they don’t seem (as) sensitive to how options are individuated. And they do still privilege an option (or outcome).

Use every option as the default

Another approach is to compare each option to every other option with a difference-making risk averse function, effectively treating each option as the default to compare to in turn. Then, use some rule to select an option that takes into account all of these comparisons, without specifically privileging any option at the start. There are multiple ways to do so, which I describe below.

Aggregating

One specific approach would be to let each option A act as the default, take the measures of difference-making risk aversion of every other option $B$ relative to that option $A$ as the default, $d(B,A)$, and sum them over all options $B$ to get $score\left(A\right)$:

Then we pick whichever option A has the lowest $score\left(A\right)$. This is the option for which the others are risk averse worst in aggregate relative to it.

Or, we vary the default option $A$ and sum $d(B,A)$ over all options $A$ to get $scor{e}^{\prime }\left(B\right)$:

and then pick whichever option B has the highest $scor{e}^{\prime }\left(B\right)$. This is the option which is the risk averse best in aggregate relative to all others.

Or, we can combine both:

and then pick whichever option A has the highest $scor{e}^{{}^{\prime \prime }}\left(A\right)$.

This too will violate the independence of irrelevant alternatives and can be sensitive to how options are individuated.

Instead of summation, we could use maximums, minimums, other aggregates or voting methods.

Tournaments

Another broad class of approaches could be tournament-based ones, like a sports tournament, e.g. elimination or knockout tournaments, where competitors — here, the options — are eliminated after a certain number of losses, or group tournaments, where competitors accumulate points based on their wins and losses and are ranked accordingly.^[11] There are many ways to structure tournaments, and these can be sensitive not only to which option is better and which is worse in a match between the two, but also by how much. The Wikipedia article on tournaments describes various kinds.

The approach above of calculating $scor{e}^{{}^{\prime \prime }}\left(A\right)$ for each option $A$ and picking whichever has the highest is a round-robin tournament, a group tournament in which each competitor plays every other, with $A$ awarded $d(A,B)-d(B,A)$ points and $B$ awarded the negative from their match.

Podgorski (2023, pdf) develops a tournament-based approach for person-affecting population-ethical views, aiming to capture certain intuitions like the procreation asymmetry.

These too will violate the independence of irrelevant alternatives and can be sensitive to how options are individuated.

A highly permissive approach

And a much more permissive approach could be to only rule out any option that is worse than another option, and no better than any other, across all comparisons with any option as default. In other words, $A$ beats $B$ if $d(A,C)\ge d(B,C)$ for each option $C$ as default, and $d(A,C)>d(B,C)$ for at least one option $C$ as default.

This too will violate the independence of irrelevant alternatives, but it doesn't seem (as) sensitive to how options are individuated.

We’ll violate the independence of irrelevant alternatives

I generally expect violations of the independence of irrelevant alternatives (IIA) in the approaches described so far. In other words, how options $A$ and $B$ compare to each other can depend on whether another option $C$ is also available.

As before, if we have a sufficiently intuitive explanation for the violation, it may not bother us much or at all. I’ve only attempted to give explanations for the random option and .

We may also be able to say more about when we should and shouldn’t expect such a sufficiently intuitive explanation. For example, even if we accept some violations of IIA, we might think which option we choose should not depend on an option $C$ that is clearly dominated by another. We should rule such an option out early and then ignore it completely in the rest of our decision-making process, because it is no longer relevant once eliminated. $C$ could be clearly dominated by $C^{\prime }$ if $d(C,C)<d(C^{\prime },C)$. Or if $C^{\prime }$ stochastically dominates $C$.

We could just identify and rule out clearly dominated options as a first step. Some decision procedures may do so as a consequence of a more general and uniform rule.

Sure vs risky options

Some of the views described above in this section can actually lend further support to riskier options than risk neutral views do. Suppose we want to compare two options:

1. $Sure$: one life is saved, and
2. $Risky$: save 1 million lives with probability 1 in a million, and do nothing otherwise.

Each option saves one life in expectation, so a risk neutral view would treat them the same.^[12]

However, suppose we use $u\left(x\right)=1-e^{-x}$ to compare them.

When $Sure$ is taken to be the default, we have^[13]

When Risky is taken to be the default, we have^[14]

And

So, $Risky$ vastly dominates $Sure$ when $Risky$ is taken to be the default, while $Sure$ only slightly beats $Risky$ when $Sure$ is taken to be the default. The above approaches in this section Not privileging inaction that are sensitive to these differences, like the aggregating approaches, would suggest we go with $Risky$. I'd guess (no formal proof) they would suggest $Risky$ no matter which increasing concave function $u$ we use, if these were the only two options. This is with no separate option for inaction, but including inaction as an option often wouldn’t make a difference.

Compared to risk neutral views, these approaches could then further favour longtermism over neartermism and invertebrate welfare over helping animals with greater probability of moral patienthood.

When making $Risky$ the default, the downsides of $Sure$ relative to it are drastically magnified. In other words, when evaluating relative $Risky$, $Risky$ acts like insurance, and $Sure$ looks very risky. A sigmoidal rather than concave function could prevent this and actually give diminishing marginal returns to downsides, but it wouldn’t necessarily imply $Sure$ beats $Risky$.

Also, in general, risky options can also be risky by having backfire risks. Such options can therefore be penalized further instead. But with the approaches above, things can go either way, or we can end up with a tie.

For example, consider $Risk{y}^{\prime }$: save 1 million + 100 lives with probability 1 in a million, lose 1 million - 100 extra lives with probability 1 in a million, and save 100 lives otherwise.

Taking the difference:

$Risk{y}^{\prime }-Sure$ = save 1 million lives with probability 1 in a million, lose 1 million extra lives with probability 1 in a million, and do nothing otherwise.

And $Sure-Risk{y}^{\prime }=Risk{y}^{\prime }-Sure$. So, if we had only these two options to consider and treated them symmetrically, we’d be indifferent between them.

1. ^{^}

    Some philosophers dispute that diminishing marginal returns (concave utility functions) actually capture risk aversion or all of risk aversion, and have moved onto other ways of capturing it (Buchat, 2022, section 5, Rethink Priorities, 2023). In this piece, I will keep the presentation using diminishing marginal returns for simplicity. The arguments I make generally apply to the other accounts. I also expect that the modifications I propose later in this piece can be adapted for other accounts of risk aversion.

2. ^{^}

    See also Russell (2023, pdf) on definitions of stochastic dominance.

3. ^{^}

    Or for its greater all-things-considered intuitive appeal to me, as a moral antirealist, roughly an ethical subjectivist.

4. ^{^}

    My own tentative view is that diet change work increases wild (terrestrial) animal populations in expectation, and this is bad because I’m suffering-focused.

5. ^{^}

    Formally, we can use their quantile functions (the inverse cumulative distribution functions) as random variables with states in the unit interval $[0,1]$ with the uniform probability over the unit interval, take statewise differences with the default option, apply our concave function to the difference in values and take the expected value.

   The quantile function of a random variable as a random variable itself has the same cumulative distribution function as the original random variable, so $A$ stochastically dominates $B$ if and only if $A^{\prime }$ stochastically dominates $B$.

6. ^{^}

    Other possibilities include comparing to the best option, or to the worst option, or a specific outcome, but the random option seems less privileging and more agnostic.

7. ^{^}

    We can think of assigning the n options the labels 1 through n randomly and without replacement, independently of any characteristics of the options themselves. Then, any fixed option $A$ has probability $1/n$ of having the label $i$, for a given $i$ between 1 and $n$. So, if our rule were to pick option $A$, and we try to identify $A$ ahead of time, the probability that we’d succeed is $1/n$.

8. ^{^}

    One problem is with the individuation of options. Say an option you are considering involves pressing a button. Should we treat it as two (or more) options if you have to decide between pressing it with your right hand or left hand, even though the difference has no foreseeable effects? And there are multitudes of ways to press that button, e.g. reaching faster or slower, every precise muscle movement, and so on. The random option will depend on how exactly individuate options and their number.

   Thanks to Derek Shiller for pointing this out.

   In response, we can just individuate options in ways that feel most intuitive or natural. This may be fairly arbitrary.

9. ^{^}

    We could have an option to flip a coin, and pick option $A$ if heads, and option $B$ if tails. In general, we can always imagine, given a set of $n$ available options, adding more options by taking probabilistic mixtures of the options already available. For one reason or another, we might not want to restrict ourselves to “pure options”, which do not involve acting randomly. It’s conceivable that we have access to a probabilistic mixture of pure options, but not every pure option of which it is a mixture. Then it’s not clear what exactly the set of available options should be, and what the random option R would be as a result.

   If we took the boundary of the convex hull of the set, i.e. every probabilistic mixture of the available options, then we can’t add any more with more probabilistic mixtures, but this set is now infinite, and it’s not clear what the random option would be. However, we could still just consider all of the pure options, available directly or in probabilistic mixtures of available options, and take the uniformly random probabilistic mixture over them to be $R$. Whether or not $R$ is actually something we could even do.

10. ^{^}

     Thanks to Derek Shiller for the suggestions in this subsection.

11. ^{^}

     We need not necessarily actually compare each option to every other option or even do so both ways, treating each as the default in turn. However, the spirit is really that any option could be compared to any other, or at least that we vary the “default option”.

12. ^{^}

     Assume, quite implausibly in reality, that the outcome of inaction is certain.

13. ^{^}

     https://www.wolframalpha.com/input?i=%281-e%5E%28-%281+million+-+1%29%29%29%2F1+million+%2B+%281+-++1%2F1+million%29+%281-e%5E1%29

14. ^{^}

     https://www.wolframalpha.com/input?i=%281-e%5E%28%281+million+-+1%29%29%29%2F1+million+%2B+%281+-++1%2F1+million%29+%281-e%5E%281%29%29