The Ethics of a Simulated Universe

Zhuangzi-Butterfly-Dream

This year one of the more thought provoking thought experiments to appear in recent memory has its tenth anniversary.  Nick Bostrom’s paper in the Philosophical Quarterly “Are You Living in a Simulation?”” might have sounded like the types of conversations we all had after leaving the theater having seen The Matrix, but Bostrom’s attempt was serious. (There is a great recent video of Bostrom discussing his argument at the IEET). What he did in his paper was create a formal argument around the seemingly fanciful question of whether or not we were living in a simulated world. Here is how he stated it:


This paper argues that at least one of the following propositions is true: (1) the human species is very likely to go extinct before reaching a “posthuman” stage; (2) any posthuman civilization is extremely unlikely to run a significant number of simulations of their evolutionary history (or variations thereof); (3) we are almost certainly living in a computer simulation. It follows that the belief that there is a significant chance that we will one day become posthumans who run ancestor-simulations is false, unless we are currently living in a simulation.

To state his case in everyday language: any technological civilization whose progress did not stop at some point would gain the capacity to realistically simulate whole worlds, including the individual minds that inhabit them, that is, they could run realistic ancestor simulations. Technologically advanced civilizations either die out before gaining the capacity to produce realistic ancestor simulations,  there is  something stopping such technologically mature civilizations from running such simulations in large numbers or, we ourselves are most likely living in such a simulation because there are a great many more such simulated worlds than real ones.

There is a lot in that argument to digest and a number of underlying assumptions that might be explored or challenged, but I want to look at just one of them, #2. That is, I will make the case that there may be very good reasons why technological civilizations both prohibit and are largely uninterested in creating realistic ancestor simulations. Reasons that are both ethical and scientific. Bostrom himself discusses the possibility that ethical constraints might prevent  technologically mature civilizations from creating realistic ancestor simulations. He writes:

One can speculate that advanced civilizations all develop along a trajectory that leads to the recognition of an ethical prohibition against running ancestor-simulations because of the suffering that is inflicted on the inhabitants of the simulation. However, from our present point of view, it is not clear that creating a human race is immoral. On the contrary, we tend to view the existence of our race as constituting a great ethical value. Moreover, convergence on an ethical view of the immorality of running ancestor-simulations is not enough: it must be combined with convergence on a civilization-wide social structure that enables activities considered immoral to be effectively banned.

I think the issue of “suffering that is inflicted on the inhabitants of a simulation” may be more serious than Bostrom appears to believe. Any civilization that has reached the stage where it can create realistic worlds that contain fully conscious human beings will have almost definitely escaped the two conditions that haunt the human condition in its current form- namely pain and death. The creation of realistic ancestor simulations will have brought back into existence these two horrors and thus might likely be considered not merely unethical but perhaps even evil. Were our world actually such a simulation it would confront us with questions that once went by the name of theodicy, namely, the attempt to reconcile the assumed goodness of the creator (for our case the simulator)  with the existence of evil: natural, moral, and metaphysical that exists in the world.

Questions as to why there is, or the morality of there being, such a wide disjunction between the conditions of any imaginable creator/simulator and those of the created/simulated is a road we’ve been down before as the philosopher Susan Neiman so brilliantly showed us in her Evil in Modern Thought: An Alternative History of Philosophy.  There, Neiman points out that the question of theodicy is a nearly invisible current that swept through the modern age. As a serious topic of thought in this period it began as an underlying assumption behind the scientific revolution with thinkers such as Leibniz arguing in his Essays on the Goodness of God, the Freedom of Man and the Origin of Evil that “ours is the best of all possible worlds”. Leibniz having invented calculus and been the first to envision what we would understand as a modern computer was no dope, so one might wonder how such a genius could ever believe in anything so seemingly contradictory to actual human experience?

What one needs to remember in order to understand this is that the early giants of the scientific revolution, Newton, Descartes, Leibniz, Bacon weren’t out to replace God but to understand what was thought of as his natural order. Given how stunning and quick what seemed at the time a complete understanding of the natural world had been formulated using the new methods it perhaps made sense to think that a similar human understanding of the moral order was close at hand. Given the intricate and harmonious picture of how nature was “designed” it was easy to think that this natural order did not somehow run in violation of the moral order. That underneath every seemingly senseless and death-bringing natural event- an earthquake or plague- there was some deeper and more necessary process for the good of humanity going on.    


The quest for theodicy continued when Rousseau gave us the idea that for harmony to be restored to the human world we needed to return to the balance found in nature, something we had lost when we developed civilization.  Nature, and therefore the intelligence that was thought to have designed it were good. Human beings got themselves into trouble when they failed to heed this nature- built their cities on fault lines, or even, for Rousseau, lived in cities at all.


Anyone who has ever taken a serious look at history (or even paid real attention to the news) would agree with Hegel that: “History… is, indeed, little more than the register of the ‘crimes, follies, and misfortunes’ of mankind”. There isn’t any room for an ethical creator there, but Hegel himself tried to find some larger meaning in the long term trajectory of history. With him, and Marx who followed on his heels we have not so much a creator, but a natural and historical process that leads to a fulfillment an intelligence or perfect society at its end. There may be a lot of blood and gore, a huge amount of seemingly unnecessary human suffering between the beginning of history and its end, but the price is worth paying.

Lest anyone think that these views are irrelevant in our current context, one can see a great deal of Rousseau in the positions of contemporary environmentalists and bio-conservatives who take the position that it is us, that is human beings and the artificial technological society we have created that is the problem. Likewise, the views of both singularitarians and some transhumanists who think we are on the verge of reaching some breakout stage where we complete or transcend the human condition, have deep echoes of both Hegel and Marx.

But perhaps the best analog for the kinds of rules a technologically advanced civilization might create around the issue of realistic ancestor simulations might lie not in these religiously based philosophical ideas but  in our regulations regarding more practical areas such as animal experimentation. Scientific researchers have long recognized that the pursuit of truth needs humane constraints and that such constraints apply not just to human research subjects, but to animal subjects as well. In the United States, standards regarding research that use live animals is subject to self-regulation and oversight based on those established by the Institutional Animal Care and Use Committee (IACUC). Those criteria are as follows:

The basic criteria for IACUC approval are that the research (a) has the potential to allow us to learn new information, (b) will teach skills or concepts that cannot be obtained using an alternative, (c) will generate knowledge that is scientifically and socially important, and (d) is designed such that animals are treated humanely.

The underlying idea behind these regulations is that researchers should never unnecessarily burden animals in research. Therefore, it is the job of researchers to design and carry out research in a way that does not subject animals to unnecessary burdens. Doing research that does not promise to generate important knowledge, subjecting animals to unnecessary pain, doing experiments on animals when the objectives can be reached without doing so are all ways of unnecessarily burdening animals.

Would realistic ancestor simulations meet these criteria? I think realistic ancestor simulations would probably fulfill criteria (a), but I have serious doubts that it meets any of the others. In terms of simulations offering us “skills or concepts that cannot be obtained using an alternative” (b), in what sense would a realistic simulations teach skills or concepts that could not be achieved using something short of such simulations where those within them actually suffer and die? Are there not many types of simulations that would fall short of the full range of subjective human experiences of suffering that would nevertheless grant us a good deal of knowledge regarding such types of worlds and societies?  There is probably an even greater ethical hurdle for realistic ancestor simulations to cross in (c), for it is difficult to see exactly what lessons or essential knowledge running such simulations would bring. Societies that are advanced enough to run such simulations are unlikely to gain vital information about how to run their own societies.

The knowledge they are seeking is bound to be historical in nature, that is, what was it like to live in such and such a period or what might have happened if some historical contingency were reversed? I find it extremely difficult to believe that we do not have the majority of information today to create realistic models of what it was like to live in a particular historical period, a recreation that does not have to entail real suffering on the part of innocent participants to be of worth.

Let’s take a specific rather than a general historical example dear to my heart because I am a Pennsylvanian- the Battle of Gettysburg. Imagine that you live hundreds or even thousands of years into the future when we are capable of creating realistic ancestor simulations. Imagine that you are absolutely fascinated by the American Civil War and would like to “live” in that period to see it for yourself. Certainly you might want to bring your own capacity for suffering and pain or to replicate this capacity in a “human” you, but why do the simulated beings in this world with you have to actually feel the lash of a whip, or the pain of a saw hacking off an injured limb? Again, if completely accurate simulations of limited historical events are ethically suspect, why would this suspicion not hold for the simulation of entire worlds?

One might raise the objection that any realistic ancestor simulation would need to possess sentient beings with free will such as ourselves that possess not merely the the ability to suffer, but to inflict evil upon others. This, of course, is exactly the argument Christian theodicy makes. It is also an argument that was undermined by sceptics of early modern theodicy- such as that put forth by Leibniz.    

Arguments that the sentient beings we are now (whether simulated or real) require free will that puts us at risk of self-harm were dealt with brilliantly by the 17th century philosopher, Pierre Bayle, who compared whatever creator might exist behind a world where sentient beings are in constant danger due to their exercise of free will to a negligent parent. Every parent knows that giving their children freedom is necessary for moral growth, but what parent would give this freedom such reign when it was not only likely but known that it would lead to the severe harm or even death of their child?

Applying this directly to the simulation argument any creator of such simulations knows that we will kill millions of our fellow human beings in war and torture, deliberately starve and enslave countless others. At least these are problems we have brought on ourselves,but the world also contains numerous so-called natural evils such as earthquakes and pandemics which have devastated us numerous times. Above all, it contains death itself which will kill all of us in the end.    

It was quite obvious to another sceptic, David Hume, that the reality we lived in had no concern for us. If it was “engineered” what did it say that the engineer did not provide obvious “tweaks” to the system that would make human life infinitely better? Why, are we driven by pain such as hunger and not correspondingly greater pleasure alone?

Arguments that human and animal suffering is somehow not “real” because it is simulated seem to me to be particularly tone deaf. In a lighter mood I might kick a stone like Samuel Johnson and squeak “I refute it thus!” In a darker mood I might ask those who hold the idea whether they would willingly exchange places with a burn victim. I think not! 

If it is the case that we live in a realistic ancestor simulation then the simulator cares nothing for our suffering on a granular level. This leads us to the question of what type of knowledge could truly be gained from running such realistic ancestor simulations. It might be the case that the more granular a simulation is the less knowledge can actually be gained from it. If one needs to create entire worlds with individuals and everything in them in order to truly understand what is going on, then the results of the process you are studying is either contingent or you are really not in possession of full knowledge regarding how such worlds work. It might be interesting to run natural selection over again from the beginning of life on earth to see what alternatives evolution might have come up with, but would we really be gaining any knowledge about evolution itself rather than a view of how it might have looked had such and such initial conditions been changed? And why do we need to replicate an entire world including the pain suffered by the simulated creatures within before we can grasp what alternatives to the path evolution or even history followed might have looked like. Full understanding of the process by which evolution works, which we do not have but a civilization able to create realistic ancestor simulations doubtless would, should allow us to envision alternatives without having to run the process from scratch a countless number of times.

Yet, it is in the last criteria (d) that experiments are  “designed such that animals are treated humanely” that the ethical nature of any realistic ancestor simulation really hits a wall. If we are indeed living in an ancestor simulation it seems pretty clear that the simulator(s) should be declared inhumane. How otherwise would the simulator create a world of pandemics and genocides, torture, war, and murder, and above all, universal death?

One might claim that any simulator is so far above us that it takes little concern of our suffering. Yet, we have granted this kind of concern to animals and thus might consider ourselves morally superior to an ethically blind simulator. Without any concern or interest in our collective well-being, why simulate us in the first place?

Indeed, any simulator who created a world such as our own would be the ultimate anti-transhumanist. Having escaped pain and death “he” would bring them back into the world on account of what would likely be socially useless curiosity. Here then we might have an answer to the second half of Bostrom’s quote above:


Moreover, convergence on an ethical view of the immorality of running ancestor-simulations is not enough: it must be combined with convergence on a civilization-wide social structure that enables activities considered immoral to be effectively banned.

A society that was technologically capable of creating realistic ancestor simulations and actually runs them would appear to have on of two features (1) it finds such simulations ethically permissible, (2) it is unable to prevent such simulations from being created. Perhaps any society that remains open to creating such a degree of suffering found in realistic ancestor simulations  for anything but the reason of existential survival would be likely to destroy itself for other reasons relating to such lack of ethical boundaries.

However, it is (2) that I find the most illuminating. For perhaps the condition that decides if a civilization will continue to exist is its ability to adequately regulate the use of technology within it. Any society that is unable to prevent rogue members from creating realistic ancestor simulations despite deep ethical prohibitions is incapable of preventing the use of destructive technologies or in managing its own technological development in a way that promotes survival. A situation we can perhaps see glimpses of in our own situation related to nuclear and biological weapons, or the dangers of the Anthropocene.

This link between ethics, successful control of technology and long term survival is perhaps is the real lesson we should glean from Bostrom’s provocative simulation argument.

11 comments on “The Ethics of a Simulated Universe

  1. James Cross says:

    The concept that the apparent world is in some way unreal can be found across many cultures and religions. Hinduism has the concept of Maya often translated as “illusion”. The idea behind it is that the physical and mental world that we behold is a veil that hides an underlying pure and absolute reality. Schools of Buddhism believe either that the perceived world is deceptive until we become enlightened or that reality itself is unreal. Chögyal Namkhai Norbu writes: “In a real sense, all the visions that we see in our lifetime are like a big dream.” The Australian Aborigines believe they exist in Dreamtime before they were born and after they die. During life a part of them lives in this world and a part in Dreamtime. Creation itself is known as “The Dreaming”. Zhuangzi, the ancient Chinese philosopher, wrote about dreaming he was butterfly and how, upon awakening, he was unsure whether he was previously a man dreaming he was a butterfly, or whether he was now a butterfly, dreaming he was a man. Christian Scientists believe that the material world is an illusion and the true reality is spiritual. Various Jewish and Christian mystics have described creation as a thought, sustained moment by moment, in the mind of God.

    Nick Bostrom’s hypothesis that we are most likely living in an ancestor simulation is really just a modern updating of the same “world is a dream” concept that has been around a long time. Once information theory is brought into the picture, the ancestor part of the hypothesis becomes redundant. If the universe is basically information (in other words bits or quanta flipping on and off), then the universe would be its own simulation. Whether we were a simulation within the simulation wouldn’t make any difference; we would still be constructed from the same unsubstantial material of dream.

    • Rick Searle says:

      Hi James,

      I know that this idea that life is a “dream” has had a hold on people since time immemorial, which is why the I began the post with an image of Zhuangzi’s Butterfly Dream.

      What I was trying to do with the post is call attention to what I find to be a contradiction or a tension point in Nick Bostrom’s thought. Bostrom is a transhumanists and the primary objectives of that movement are the abolition of pain and death through science and technology. The perspective best exemplified by David Pearce’s Abolitionist Philosophy.

      Bostrom in his original article had thought the ethical objections to realistic ancestor simulations were not substantial and I was trying to point out, no, from the standpoint of transhumanist ethics they are really quite substantial indeed.

      • James Cross says:

        I know what you are trying to do but first point is that I find Bostrom’s argument incorrect so arguing from it doesn’t provide value.

        But to revisit one more time another discussion we had on this. Applying ethics to simulations does not make much sense. Would running a simulation of a world with pain, suffering, and death be any different from playing a video game with shooting, violence, and death? You might argue that the video game somehow might be detrimental to society in that makes us more likely or willing to engage in violence but surely you are not saying killing someone in the video game is the equivalent to killing an actual person. Yet the actors in a simulation would in a sense be no different from the characters in a video game. The actors in the simulation would be more complex with inbuilt feature that allows them to experience suffering (and pleasure and joy) but they would be no more real than the video game characters.

      • Rick Searle says:

        Oh, this is exactly what I am saying. If you had an advanced enough video game where the characters had ACTUAL subjective experience then, say, raping a character in this game would be very much unethical for the player. The reason a person can kill thousands of characters in a video game with out any qualms at all is precisely because these characters are “flat” they have no subjective experience at all. It’s not whether something is simulated or not that counts but whether it can actually FEEL.

        I have often thought that a break out video game designer might do us a great ethical service by designing characters with sufficient back stories- families etc that we would struggle with doing them harm. This would go against the grain of what we are doing now- creating a generation that find it quite easy to kill so long as the architecture around the killing is video game “like”- think drone pilots.

  2. Hi Rick,

    I don’t have enough time right now to compose a long reply, but this post is related to some philosophical lines of thought I’ve been working through. So I’ll jot down a few thoughts:

    1) A simulation could be designed to explore different physical constants and laws – complex life appearing could be incidental to the generation of new information, or intentional.
    2) I currently think that subjective experience (consciousness) is real regardless of the substrate – sufficiently precise simulations of people are real people.
    3) Pain and suffering are evolved states of experience that direct us away from things in the environment that reduce our reproductive potential – neither pain nor suffering are “bad”, they are crucial elements of learning.
    4) In a simulation, the subjective experiences of all those that die could be preserved – people that die would, in a sense, not be dead.
    5) Given information creation and learning as the highest values, a simulation of the universe could be considered a “good” thing, including the pain and suffering that occurs.

    These points incorporate a few aspects of an ethical value system I’m working on. I’d be interested to get your views on this superficial treatment of simulated universes (and future posts I hope to make explaining this ethical system).

    Toby

    • Rick Searle says:

      Hi Toby,

      I’ll happily give you my feedback. Here are my views on the points you have laid out so far.

      1) One of the things I find interesting about contemporary physics is that it seems to be moving away from the idea that the only type of universe that exists has to have the same physical laws found in our own, or even the same mathematics. The version of this that seems intuitively right for me is a for all practical purposes an infinite plane upon which exists an equally bewildering number of universes with different physical laws. According to the models I’ve seen, if these other universes exists we can NEVER get any direct information from them, they remain off limits in terms of our knowledge. So I could see, as you suggest, some future civilization running very complex models of these complex universes because this inferred knowledge is all we will ever get. These same current models of physics also hold a strong version of the anthropic principle and argue that we live in the kind of universe we find ourselves in because ONLY the type of universe we find ourselves in would be capable of allowing for complex life. In light of your suggestion that the appearance of complex life in simulations will be incidental or intentional- the vast vast majority of such models run would not give rise to intelligent life so I find it hard to believe its appearance would be incidental. If it is intentional it seems unlikely to bring any great advance in knowledge over a deep understanding of the universe the simulators live in- because the physical laws will be the same. Because such models are unlikely to bring huge advances in knowledge the ethical questions I raised as to whether simulation is ethical, I think, come into play.

      2) I am open to this possibility, though we are far from there yet.

      3) Certainly pain in terms of being the body’s early warning system or as conditioned response is a form of learning, but I am suspicious that much that actually falls under the rubric of pain or suffering is educational in this way. To think otherwise, I think, seems to imply that it was designed which we both agree it was not. Think about it in terms of something light years away from real human suffering like an itch. The fact that you have an itch and find the need to scratch it has nothing to do with YOU it is the interest of the fungus or whatever causing you to itch and scratch and therefore spread the fungus. I think at bottom more of human pain and suffering is like a fungus than it is a type of education.

      4) This sounds like the view of Frank Tippler in his Physics of Immortality. I used to have some sympathy with these views, but now am deeply skeptical.
      In a lot of ways this view is trying to get to the end point of traditional religion i.e. personal immortality while clinging to materialist assumptions.
      Problem is, it runs into exactly the same problems traditional religious concepts confront while being bereft of all the good things traditional religion brings in terms of community and ethics. Just like the somewhat silly Catholic idea of “ensoulment” when and for whom does this preservation of information
      occur? Are the thoughts of just human beings preserved or all hominids? Why limit it to hominids? Shouldn’t we throw in the great apes? Dolphins? All mammals? Are the memories of all human beings preserved? What about infants who die days after birth? In the womb?

      5) I love learning new things and creating knowledge when I can, but as I suggest in my post I think there are greater values than the generation of information, as our experience with horrific human and animal experiments attest.

      I hope these comments were helpful and hope I did not sound to harsh in making my point. Best of luck on your quest, and if you would like any feedback I am always happy to do so whatever it is worth.

      Rick

      • Hi Rick,

        Thanks for the detailed response. I think the feedback you have provided is useful, so I imagine any feedback you can provide me in future will be too.

        I agree with you in many of the points you raised, but think there are some other areas in which we might have different opinions.

        1) I agree that it is reasonable to think that entities simulating universes with different physical laws would have greater interest in the development of complex life. So it makes sense that a simulator would consider the ethics of making simulations that have suffering and death. Though it is only speculation, it is conceivable that the simulators may have difficulty interfering with a simulation that is running, or that the simulators have different values could make the simulation worthwhile, despite the suffering and death. I think valuing the creation and preservation of information could be one such value system that makes simulations an attractive proposition.

        2) We aren’t capable of creating anything resembling human consciousness yet, but I think there is a reasonable amount of evidence that supports the idea that neurons activating are responsible for our conscious representations of the world. More generally, if simulations aren’t capable of being conscious, then we are either not be in a simulation or not conscious. Also there should be less concern for the suffering in simulations, since they are not conscious.

        3) I do agree that much pain and suffering does not present any “useful” learning or experience. And that pain and suffering, like any similarly unproductive experience, could be justifiably avoided. What I think is important to note is that pain and suffering isn’t inherently bad. So it shouldn’t be necessary to create a universe with absolutely no pain and suffering for it to be morally acceptable.

        4) Again this is just speculation, but the preservation of information in a simulation could happen at the smallest level of granularity available, e.g., quantum states or strings. So all information could be preserved at all instants in time, resulting in all matter and all consciousness that goes along with it being preserved at all time instants. This seems fairly fanciful, and does have religious parallels, so I think it is highly doubtful that this is happening. But if this were the case, given an information-based value system, I would consider suffering and death to less serious ethical issues. I think where I’m heading with this is some sort of universal consciousness that stores/remembers all the experiences and information generated in the simulation. Much like an omniscient and omnipresent god I suppose.

        5) The definition of information I’m trying to work with is broader than the usual concept. In its broadest sense, the definition includes information “about something” (descriptions of things), “as something” (embodiments of information), “for something” (descriptions of actions) and “in something” (encoded meaning). This is based on a definition by the philosopher Luciano Floridi (1). In any case, I think the most valuable forms of information is that embodied as living organisms. Especially organisms that are rare or highly individualised. Nevertheless, under this value system many ethical issues remain complex and unintuitive (and sometimes unappealing) standpoints seem to emerge, so I may yet abandon it.

        After all that, I would summarise by saying: I think that if this universe is a creation, the suffering and pain wouldn’t be unethical if all the “information”, including the experiences, were preserved.

        Thanks again for the feedback, if you have any more follow up comments I would be interested to hear them! 🙂

        (1) http://en.wikipedia.org/wiki/Philosophy_of_information#Floridi

      • Rick Searle says:

        It does indeed sound like you are on an interesting quest. I will offer you one warning as it were and one suggestion.

        In terms of warning I think you should be on guard that you are not constructing a very elaborate argument for what you WANT to be true. I might be seeing this out of my own prejudice or because of my own particular perspective, but from the outside your ideas ring of wanting to overcome oblivion. That is, you hope to preserve the memory of what was. I tend to try to locate meaning in the present, and don’t think either personal death or even the disappearance of the universe over the very long-haul effects this meaning at all.

        In terms of a suggestion, though might seem antiquarian to you, I suggest that you check out Plato’s Phaedo. It is the dialogue of Socrates right before his death in which he makes the case for the preservation of the soul in the form of its ideas. It is really quite a beautiful and illuminating dialogue and at least touches upon a number of the issues you are grappling with.

  3. […] war and plague were common forms of death, and which lacked modern miracles such as anesthesia, when such world could easily be created with more humane features, was not “redemptive” but amounted to cruel and unusual punishment and even […]

  4. […] we start imagining that we can play the role of creator it seems we are unable to escape the same moral failings the religious would have once held against God. Here is Lem imagining a far future when we could create a simulated universe inhabited by virtual […]

  5. […] For my part, I have trouble believing I am living in a simulation. Running “ancestor simulations” seems like something a being with human intelligence might do, but it would probably bore the hell out of any superintelligence capable of actually creating the things, they would not provide any essential information for their survival, and given the historical and present suffering of our world would have to be run by a very amoral, i…. […]

Leave a comment