Superintelligence by Nick Bostrom
Superintelligence by Nick Bostrom is a key work exploring artificial intelligence. Many including Bill Gates and Stephen Hawking, have publicly expressed their concerns that artificial intelligence could cause the extinction of man. The threshold of great concern is when artificial intelligence software can write and correct software as well as learn. It is believed once such thresholds are crossed it will be able to reason and protect itself by planting code all over the world via networks while hiding its actions and motivations. At that point it “can’t be unplugged” and could get exponentially smarter than humans maybe even deciding humans are its biggest enemy i.e. “The Terminator Scenario”. This is a complex area being widely written about these days since artificial intelligence and machine learning are progressing at lightning speeds.
This particular book is somewhat technical looking at different strategies that might be taken in artificial intelligence development to prevent bad outcomes and loss of control. None of the strategies give me great confidence we can in fact contain what could be the development of our very own downfall. Fascinating topic and one of great importance whether we realize it not since we are charging down path. This one is on the technical side so if this is a topic you want to explore at the more macro level you might start with other books on the topic and work your way up to this one. A great one to start with is Our Final Invention by James Barat which I reviewed on this site back in May 2014 https://marksbookreviews.wordpress.com/2014/05/20/our-final-invention-by-james-barrat/ .
So as usual Hit The Books, They Don’t Hit Back!