On the Singularity list, Matt Mahoney said:
For uploads [future human mind uploads to a computer], it is a legal problem. Consider what uploading is. You sign a contract with a hosting company that they will run a program that simulates you after you die. Upon your death, you transfer control of your wealth to the hosting company with the stipulation that the property be controlled as directed by this program. However, if the hosting company breaches the contract, you have no legal recourse because you are dead. Even if we pass laws that give protections to these programs, they would be very difficult to enforce. For example, the hosting company might secretly modify your mind model so that it wants to give your possessions to them. How would such tampering be detected?
Another legal question is to define the circumstances under which tampering is permitted. Suppose the upload commits a crime. Legally, the hosting company is responsible, just like it is the virus writer and not the virus that is responsible for infecting your computer. So the upload hosting company has a legal obligation to modify your mind model to prevent it from doing anything illegal. It does not seem to make any sense to me to transfer that responsibility to the program. How would you sentence an upload to jail?
Over the years, I’ve thought about obtaining a Limited Liability Corporation for Texai. I have one already for my family’s landlording business and they are easy and inexpensive to get. As long as I am alive, I could be the owner of my Texai instance LLC, then upon the death of my body, ownership of my Texai instance LLC, and its associated lifelog, mind upload, etc. would pass into a corporation, as a subsidiary AGI LLC, that human owners of Texai instances trust.
Having AGI instances be legal business entities permits them to be paid for services rendered, to inherit wealth, to own and to control real estate and capital, to be governed by the nested legal jurisdictions in which they operate, to enter into binding contracts with human individuals and with other business entities, and to pay taxes. If such a business entity AGI misbehaves by breaking some law, then the courts and the law are applicable as currently for any other business entity. There may not be a human owner of the subsidiary AGI LLC still alive to put in jail, but the courts could punish an AGI LLC by fining it, by making it pay damages to the injured parties, by compelling changes to its organization, by removing conflicts of interest, or as the most severe punishment – removing its resources.
By my way of thinking, every AGI LLC itself would evaluate, shop around, and pay for compute resources, storage, bandwidth, and robotic peripherals, that it needed, and not be solely dependent upon a possibly untrustworthy hosting company.