Robin Hanson on his methods
My usual first tool of analysis is competition and selection.
To predict what rich creatures do, you need to know what they want. To predict what poor creatures do, you just need to know what they need to do to survive.
Looking back through history it is clear that humanity has not been driving the train. There has been this train of progress or change and it has been a big fast train, especially lately, and it is making enormous changes all through the world but it is not what we would choose if we sat down and discussed it or voted. We just don’t have a process for doing that.
Whatever processes that changed things in the past will continue. So I can use those processes to predict what will happen. I am assuming we will continue to have a world with many actions being taken for local reasons as they previously were. But that’s a way to challenge my Age of Em hypothesis: you can say no, we will between now and then acquire an ability to foresee the consequences of such changes and to talk together and to vote together on do we want it, and we will have the ability to implement such choices and that will be a change in the future that will prevent the Age of Em.
https://notunreasonable.com/2022/03/21/robin-hanson-on-distant-futures-and-aliens%ef%bf%bc/
Dominic Cummings: given they don’t take nuclear weapons seriously, never assume they’re taking X seriously
For many years I’ve said that a Golden Rule of politics is that, given our leaders don’t take nuclear weapons seriously, never assume they’re taking X seriously and there is a team deployed on X with the incentives and skills to succeed.
People think this is an overstated metaphor but I always meant it literally.
Having explored the nuclear enterprise with deep state officials 2019-20, I can only stress just how extremely literally I mean this Golden Rule.
https://dominiccummings.substack.com/p/people-ideas-machines-ii-catastrophic
Joe Carlsmith on expected utility maximisation
There’s nothing special about small probabilities—they’re just bigger conditional probabilities in disguise.
[…]
Suppose the situation is: 1000 people are drowning. A is a certainty of saving one of them, chosen at random. B is a 1% chance of saving all of them.
Thus, for each person, A gives them a .1% chance of living; whereas B gives them a 1% chance. So every single person wants you to choose B. Thus: if you’re not choosing B, what are you doing, and why are you calling it “helping people”? Are you, maybe, trying to “be someone who saved someone’s life,” at the cost of making everyone 10x less likely to live? F*** that.
[…]
If, in the face of a predictable loss, it’s hard to remember that e.g. you value saving a thousand lives a thousand times more than saving one, then you can remember, via coin-flips, that you value saving two twice as much as saving one, saving four twice as much as saving two, and so on.
[…]
There’s a vibe […] that’s fairly core to my own relationship with EUM: namely, something about understanding your choices as always “taking a stance,” such that having values and beliefs is not some sort of optional thing you can do sometimes, when the world makes it convenient, but rather a thing that you are always doing, with every movement of your mind and body. And with this vibe in mind, I think, it’s easier to get past a conception of EUM as some sort of “tool” you can use to make decisions, when you’re lucky enough to have a probability assignment and a utility function lying around — but which loses relevance otherwise. EUM is not about “probabilities and utilities first, decisions second”; nor, even, need it be about “decisions first, probabilities and utilities second,” as the “but it’s not action-guiding!” objectors sometimes assume. Rather, it’s about a certain kind of harmony in your overall pattern of decisions — one that can be achieved by getting your probabilities and utilities together first, and then figuring out your decisions, but which can also be achieved by making sure your decision-making satisfies certain attractive conditions, and letting the probabilities and utilities flow from there. And in this latter mode, faced with a choice between e.g. X with certainty, vs. Y if heads (and nothing otherwise), one need not look for some independently specifiable unit of value to tally up and check whether Y has at least twice as much of it as X. Rather, to choose Y-if-heads, here, just is to decide that Y, to you, is at least twice as valuable as X.
I emphasize this partly because if — as I did — you turn towards the theorems I’ll discuss hoping to answer questions like “would blah resources be better devoted to existential risk reduction or anti-malarial bednets?”, it’s important to be clear about what sort of answers to expect. There is, in fact, greater clarity to be had, here. But it won’t live your life for you (and certainly, it won’t tell you to accept some particular ethic — e.g., utilitarianism). Ultimately, you need to look directly at the stakes — at the malaria, at the size and value of the future — and at the rest of the situation, however shrouded in uncertainty. Are the stakes high enough? Is success plausible enough? In some brute and basic sense, you just have to decide.
https://handsandcities.com/2022/03/16/on-expected-utility-part-1-skyscrapers-and-madmen/ https://handsandcities.com/2022/03/18/on-expected-utility-part-2-why-it-can-be-ok-to-predictably-lose/
Francis Bacon on pragmatism
The roads to human power and to human knowledge lie close together, and are nearly the same; nevertheless, on account of the pernicious and inveterate habit of dwelling on abstractions, it is safer to begin and raise the sciences from those foundations which have relation to practice and let the active part be as the seal which prints and determines the contemplative counterpart.
https://en.wikisource.org/wiki/Novum_Organum/Book_II_(Spedding)
Adam Waytz on The Illusion of Explanatory Depth
If you asked one hundred people on the street if they understand how a refrigerator works, most would respond, yes, they do. But ask them to then produce a detailed, step-by-step explanation of how exactly a refrigerator works and you would likely hear silence or stammering. This powerful but inaccurate feeling of knowing is what Leonid Rozenblit and Frank Keil in 2002 termed, the illusion of explanatory depth (IOED), stating, “Most people feel they understand the world with far greater detail, coherence, and depth than they really do.”
Rozenblit and Keil initially demonstrated the IOED through multi-phase studies. In a first phase, they asked participants to rate how well they understood artifacts such as a sewing machine, crossbow, or cell phone. In a second phase, they asked participants to write a detailed explanation of how each artifact works, and afterwards asked them re-rate how well they understand each one. Study after study showed that ratings of self-knowledge dropped dramatically from phase one to phase two, after participants were faced with their inability to explain how the artifact in question operates. Of course, the IOED extends well beyond artifacts, to how we think about scientific fields, mental illnesses, economic markets and virtually anything we are capable of (mis)understanding.
Cass Sunstein and Richard Thaler on libertarian paternalism
Our central empirical claim here has been that in many domains, people’s preferences are labile and ill-formed, and do not predate social and legal contexts. For this reason, starting points and default rules are likely to be quite sticky. Building on empirical work involving rationality and preference formation, we have sketched and defended libertarian paternalism — an approach that preserves freedom of choice but that encourages both private and public institutions to steer people in directions that will promote their own welfare.
Some kind of paternalism, we believe, is likely whenever such institutions set out default plans or options. Unfortunately, many current social outcomes are both random and inadvertent, in the sense that they are a product of default rules whose behaviorshaping effects have never been a product of serious reflection. In these circumstances, the goal should be to avoid arbitrary or harmful consequences and to produce contexts that are likely to promote people’s welfare, suitably defined.
Cass Sunstein, Richard Thaler (2006) ‘Preferences, Paternalism, and Liberty’ http://journals.cambridge.org/abstract_S135824610605911X
quote cass sunstein richard thaler political philosophy libertarianism