Russell, Bostrom and the Risk of AI

The way we use machines that do not think on their own, is that we establish some kind of regime to distinguish between authorized users and unauthorized users (cars have keys, computers have passwords) and then the machine is simply designed to do what its authorized user directs it to do. I notice that the article on the risks of AI does not discuss Asimov's Laws of Robotics. Laws #1 and #2 lead to endless complications, which is why Isaac Asimov was able to compose so many interesting works of science fiction based on those complications. But law #3 is quite simple. Robots must do what people tell them to do. That is implicitly how machines work anyway, even when not specifically programmed with such an instruction. They do what people tell them to do, because they have a control interface of some kind which is designed to allow people to control them. But an AI might require a more complicated arrangement. It might need to be specifically programmed to recognize that its purpose is to do what its authorized user tells it to do. That would seem to be the obvious means of avoiding the disasters which might result from other types of purposes (such as manufacturing paper clips, in the example given).

We might still be concerned about the possibility that an AI under the control of a person is still very dangerous because it gives too much power to that person. We could compare this to building nuclear weapons. Nuclear weapons only do what we tell them to do, and they have no plans of their own, but they are still a very dangerous tool to place in the hands of fallible human beings.

Still, the possibility of harnessing the power of a greater than human intelligence seems too good to pass up. It might be necessary to figure out a way of creating a trustworthy committee - perhaps in the way that the Supreme Court is entrusted with great legal power - who can give orders to the AI.

Even if we take very careful and appropriate precautions, I can see that there would be some possibility of things going wrong. Powerful technology does bring with it certain risks. Even so, I think that the potential benefits justify taking some risks.

/r/samharris Thread Link - medium.com