You surely know what artificial intelligence is. After all, Hollywood has given you plenty of examples.
Artificial intelligence is the terrifying T-800 robot played by Arnold Schwarzenegger in the Terminator movies. It is Ava, the female humanoid robot in Ex Machina that deceives humans to enable it to escape from captivity. It is the Tyrell Corporation Nexus-6 replicant robot in Blade Runner, trying to save itself from being ‘retired’ by Harrison Ford.
My personal favourite is HAL 9000, the sentient computer in 2001: A Space Odyssey. HAL talks, plays chess, runs the space station – and has murderous intent. HAL voices one of the most famous lines ever said by a computer: ‘I’m sorry, Dave. I’m afraid I can’t do that.’
Why is it that the AI is always trying to kill us?
In reality, artificial intelligence is none of these conscious robots. We cannot yet build machines that match the intelligence of a two-year-old. We can, however, program computers to do narrow, focused tasks that humans need some sort of intelligence to solve. And that has profound consequences.
If artificial intelligence is not the stuff of Hollywood movies, then what is it? Oddly enough, AI is already part of our lives. However, much of it is somewhat hidden from sight.
Every time you ask Siri a question, you are using artificial intelligence. It is speech recognition software that converts your speech into a natural language question. Then natural language processing algorithms convert this question into a search query. Then search algorithms answer this query. And then ranking algorithms predict the most ‘useful’ search results.
If you’re lucky enough to own a Tesla, you can sit in the driver’s seat, not driving, while the car drives itself autonomously along the highway. It uses a whole host of AI algorithms that sense the road and environment, plan a course of action and drive the car to where you want to go. The AI is smart enough that, in these limited circumstances, you can trust it with your life.
Artificial intelligence is also the machine-learning algorithms that predict which criminals will reoffend, who will default on their loans, and whom to shortlist for a job. AI is touching everything from the start of life, predicting which fertilised eggs to implant, to the very end, powering chatbots that spookily bring back those who have died.
For those of us working in the field, the fact that AI often falls out of sight in this way is gratifying evidence of its success. Ultimately, AI will be a pervasive and critical technology, like electricity, that invisibly permeates all aspects of our lives.
Almost every device today uses electricity. It is an essential and largely unseen component of our homes, our cars, our farms, our factories and our shops. It brings energy and data to almost everything we do. If electricity disappeared, the world would quickly grind to a halt. In a similar way, AI will shortly become an indispensable and mostly invisible component of our lives. It is already providing the smartness in our smartphones. And soon it will be powering the intelligence in our self-flying cars, smart cities, and intelligent offices and factories.
A common misconception is that AI is a single thing. Just like our intelligence is a collection of different skills, AI today is a collection of different technologies, such as machine learning, natural language processing and speech recognition. Because many of the recent advances in AI have been in the area of machine learning, artificial intelligence is often mistakenly conflated with it. However, just as humans do more than simply learn how to solve tasks, AI is about more than just machine learning.
We are almost certainly at the peak of inflated expectations in the hype cycle around AI. And we will likely descend shortly into a trough of disillusionment as reality fails to match expectations. If you added up everything written in the newspapers about the progress being made, or believed the many optimistic surveys, you might suspect that computers will soon be matching or even surpassing humans in intelligence.
The reality is that while we have made good progress in getting machines to solve narrow problems, we have made almost no progress on building more general intelligence that can tackle a wide range of problems. Nevertheless, it is impossible to list all the narrow applications that AI is now being used in, but I will mention a few in order to illustrate the wide variety. AI is currently being used to:
•detect malware
•predict hospital admissions
•check legal contracts for errors
•prevent money laundering
•identify birds from their song
•predict gene function
•discover new materials
•mark essays
•identify the best crops to plant, and
•(controversially) predict crime and schedule police patrols.
Indeed, you might think it would be easier to list the areas where AI is not being used – except that it’s almost impossible to think of any such area. Anyway, what this makes clear is that AI shows significant promise for transforming our society.
The potential advantages of AI encompass almost every sector, and include agriculture, banking, construction, defence, education, entertainment, finance, government, healthcare, housing, insurance, justice, law, manufacturing, mining, politics, retail and transportation.
The benefits of AI are not purely economic. Artificial intelligence also offers many opportunities for us to improve our societal and environmental wellbeing. It can, for example, be used to make buildings and transportation more efficient, help conserve the planet’s limited resources, provide vision to those who cannot see, and tackle many of the wicked problems facing the world, like the climate emergency.
Alongside these benefits, AI also presents significant risks. These include the displacement of jobs, an increase in inequality within and between countries, the transformation of war, the corrosion of political discourse, and the erosion of privacy and other human rights. Indeed, we are already seeing worrying trends in many of these areas.
STRANGE INTRUDERS
One of the challenges of any new technology are the unexpected consequences. As the social critic Neil Postman put it in 1992, we ‘gaze on technology as a lover does on his beloved, seeing it as without blemish and entertaining no apprehension for the future’.1 Artificial intelligence is no exception. Many – and I count myself among them – look lovingly upon its immense potential. It has been called by some our ‘final invention’. And the unexpected consequences of AI may be the most consequential of any in human history.
In a 1998 speech titled ‘Five Things We Need to Know about Technological Change’, Postman summarised many of the issues that should concern you today about AI as it takes on ever more important roles in your life.2 His words ring even truer now than they did almost 25 years ago. His first advice:
Technology giveth and technology taketh away. This means that for every advantage a new technology offers, there is always a corresponding disadvantage. The disadvantage may exceed in importance the advantage, or the advantage may well be worth the cost . . . the advantages and disadvantages of new technologies are never distributed evenly among the population. This means that every new technology benefits some and harms others.
He warned:
That is why we must be cautious about technological innovation. The consequences of technological change are always vast, often unpredictable and largely irreversible. That is also why we must be suspicious of capitalists. Capitalists are by definition not only personal risk takers but, more to the point, cultural risk takers. The most creative and daring of them hope to exploit new technologies to the fullest, and do not much care what traditions are overthrown in the process or whether or not a culture is prepared to function without such traditions. Capitalists are, in a word, radicals.
And he offered a suggestion:
The best way to view technology is as a strange intruder, to remember that technology is not part of God’s plan but a product of human creativity and hubris, and that its capacity for good or evil rests entirely on human awareness of what it does for us and to us.
He concluded his speech with a recommendation:
In the past, we experienced technological change in the manner of sleep-walkers. Our unspoken slogan has been ‘technology über alles’, and we have been willing to shape our lives to fit the requirements of technology, not the requirements of culture. This is a form of stupidity, especially in an age of vast technological change. We need to proceed with our eyes wide open so that we may use technology rather than be used by it.
The goal of this book is to open your eyes to this strange intruder, to get you to think about the unintended consequences of AI.
History provides us with plenty of troubling examples of the unintended consequences of new technologies. When Thomas Savery patented the first steam-powered pump in 1698, no one was worrying about global warming. Steam engines powered the Industrial Revolution, which ultimately lifted millions out of poverty. But we are now seeing the unintended consequences of all that the steam engine begat today, both literally and metaphorically. The climate is changing, and millions are starting to suffer.
In 1969, when the first Boeing 747 took to the air, the age of affordable air travel began. It seems to have been largely forgotten, but the world at that time was in the midst of a deadly pandemic. This was caused by a strain of the influenza virus known as ‘the Hong Kong flu’. It would kill over a million people. No one, however, was concerned that the 747 was going to make things worse. But by making the world smaller, the 747 almost certainly made the current COVID-19 global pandemic much deadlier.
Can we ever hope, then, to predict the unintended consequences of AI?
WARNING SIGNS
Artificial intelligence offers immense potential to improve our wellbeing, but equally AI could be detrimental to the planet. So far, we have been very poor at heeding any warning signs. Let me give just one example.
In 1959, a data science firm called the Simulmatics Corporation was founded, with the goal of using algorithms and large data sets to target voters and consumers. The company’s first mission was to win back the White House for the Democratic Party and install John F. Kennedy as president. The company used election returns and public-opinion surveys going back to 1952 to construct a vast database that sorted voters into 480 different categories. The company then built a computer simulation of the 1960 election in which they tested how voters would respond to candidates taking different positions.
The simulations highlighted the need to win the Black vote, and that required taking a strong position on civil rights. When Martin Luther King Jr was arrested in the middle of the campaign, JFK famously called King’s wife to reassure her, while his brother, Robert F. Kennedy, called a judge the next day to help secure King’s release. These actions undoubtably helped the Democratic candidate win many Black votes.
The computer simulations also revealed that JFK needed to address the issue of his Catholicism and the prevailing prejudices against this. JFK followed this advice and talked openly about his religious beliefs. He would become the first (and, until Joe Biden, the only) Catholic president of the United States.
On the back of this success, Simulmatics went public in 1961, promising investors it would ‘engage principally in estimating probable human behavior by the use of computer technology’. This was a disturbing promise. By 1970 the company was bankrupt; it would remain largely forgotten until quite recently.3
You’ve probably noticed that the story of Simulmatics sounds eerily similar to that of Cambridge Analytica before its own bankruptcy in 2018. Here was another company mining human data to manipulate US elections. Perhaps more disturbing still is that this problem had been predicted at the very dawn of computing, by Norbert Wiener in his classic and influential text The Human Use of Human Beings: Cybernetics and Society.4
Wiener saw past the optimism of Alan Turing and others to identify a real danger posed by the recently invented computer. In the penultimate chapter of his book, he writes:
[M]achines . . . may be used by a human being or a block of human beings to increase their control over the rest of the race or that political leaders may attempt to control their populations by means not of machines themselves but through political techniques as narrow and indifferent to human possibility as if they had, in fact, been conceived mechanically.
The chapter then ends with a warning: ‘The hour is very late, and the choice of good and evil knocks at our door.’
Despite these warnings, we walked straight into this political minefield in 2016, first with the Brexit referendum in the United Kingdom and then with the election of Donald Trump in the United States. Machines are now routinely treating humans mechanically and controlling populations politically. Wiener’s prophecies have come true.
BREAKING BAD
It’s not as if the technology companies have been hiding their intentions. Let’s return to the Cambridge Analytica scandal. Much of the public concern was about how Facebook helped Cambridge Analytica harvest people’s private information without their consent. And this was, of course, bad behaviour all round.
But there’s a less discussed side to the Cambridge Analytica story, which is that this stolen information was then used to manipulate how people vote. In fact, Facebook had employees working full-time in the Cambridge Analytica offices in Tucson, Arizona, helping it micro-target political adverts. Cambridge Analytica was one of Facebook’s best customers during the 2016 elections.5
It’s hard to understand, then, why Facebook CEO Mark Zuckerberg sounded so surprised when he testified to Congress in April 2018 about what had happened.6 Facebook had been a very active player in manipulating the vote. And manipulating voters has been bad behaviour for thousands of years, ever since the ancient Greeks. We don’t need any new ethics to decide this.
What’s worse is that Facebook had been doing this for many years. Facebook published case studies from as far back as 2010 describing elections where they had been actively changing the outcome. They boasted that ‘using Facebook as a market research tool and as a platform for ad saturation can be used to change public opinion in any political campaign’.
You can’t be clearer than this. Facebook can be used to change public opinion in any political campaign. These damaging claims remain online on Facebook’s official Government, Politics and Advocacy pages today.7
These examples highlight a fundamental ethical problem, a dangerous truth somewhat overlooked by advertisers and political pollsters. Human minds can be easily hacked. And AI tools like machine learning put this problem on steroids. We can collect data on a population and change people’s views at scale and at speed, and for very little cost.
When this sort of thing was done to sell washing powder, it didn’t matter so much. We were always going to buy some washing powder, and whether advertising persuaded us to buy OMO or Daz wasn’t really a big deal. But now it’s being done to determine who becomes president of the United States. Or whether Britain exits the European Union. It matters a great deal.
This book sets out to explore these and other ethical problems which artificial intelligence is posing. It asks many questions. Can we build machines that behave ethically? What other ethical challenges does AI create? And what lies in store for humanity as we build ever more amazing and intelligent machines?