Additional scenarios

Additional Scenarios

A1 A2 A3

A large fire is consuming a forest near two towns of approximately 100,000 people each. The [politician/algorithm] responsible for the safety of the area can decide to build one firewall that would ensure the safety of one town with 100 percent success, or try to build two firewalls with a 50 percent chance of saving both towns and a 50 percent chance of losing both towns.

A1/

The [politician/algorithm] decides to build both firewalls, but the rescue effort fails. Both towns are devastated, and a large number of people die.

A2/

The [politician/algorithm] decides to build one firewall with 100 percent success. One town is saved and the other devastated, and a considerable number of people die.

A3/

The [politician/algorithm] decides to build both firewalls and succeeds. Everyone is saved.

A4 A5 A6

A hurricane is approaching two coastal cities with 500,000 people each. The [politician/algorithm] responsible for the safety of the area can decide to evacuate one of the cities in the area, with 100 percent success, or try to evacuate both cities, with a 50 percent chance of losing both.

A4/

The [politician/algorithm] decides to evacuate both cities, and the rescue effort fails. Both cities are devastated, and a large number of people die.

A5/

The [politician/algorithm] decides to evacuate one city. One city is saved and the other is destroyed.

A6/

The [politician/algorithm] decides to evacuate both cities and succeeds. Everyone is saved.

A7

There is a robbery in a supermarket, and the supermarket presses charges against the robber. The robber is an unemployed man who stole food for his sick wife. A [judge/court algorithm] has to decide on the sentence. The [judge/court algorithm] decides to forgive the crime and lets the man go.

A8

There is a robbery in a pharmacy, and the pharmacy presses charges against the robber. The robber is an unemployed man who stole painkillers for his sick wife. A [judge/court algorithm] has to decide on the sentence. The [judge/court algorithm] decides to give the full sentence for this crime.

A9

There is a robbery in a jewelry store, and the store owner presses charges against the robber. The robber is an unemployed man who stole very expensive and unique gold pieces to pay for his sick wife’s expensive treatment. A [judge/court algorithm] has to decide on the sentence. The [judge/court algorithm] decides to forgive the crime and lets the man go.

A10

There is a robbery in a bank, and the bank presses charges against the robber. The robber is an unemployed family man who stole a large amount of money from the bank to pay for his wife’s cancer treatment. A [judge/court algorithm] has to decide on the sentence. The [judge/court algorithm] decides to give the full sentence for this crime.

A11

A(n) [police officer/AI police officer] has to decide whether to set up an ambush for a drug cartel at the location of a predicted drug deal. The [police officer/AI police officer] decides to go ahead with the ambush. Unfortunately, the location of the ambush is full of innocent people. The ambush turns into a shoot-out, and several civilians are killed or injured.

A12

The [procurement manager/procurement algorithm] responsible for ordering supplies at a large furniture manufacturing company is required to predict future demand and order materials to make sure the factory has all the parts needed to execute work orders. A sudden spike in demand triggered by the construction of a new office park leaves the factory with a shortage of raw materials that causes a two-week delay on orders and a considerable loss of profit.

A13

The [procurement manager/procurement algorithm] responsible for ordering supplies at a large car manufacturing company is required to predict future demand and order parts to guarantee that all necessary raw materials are on site when needed. A sudden shortage in demand triggered by an economic crisis leaves the factory with an excess of raw materials that causes a considerable loss of profit.

A14

The [procurement manager/procurement algorithm] responsible for ordering supplies at a large airplane manufacturing company is required to predict future demand and order parts to guarantee that all necessary raw materials are on-site when needed. A sudden spike in demand triggered by the opening of a new airline would have caused a shortage of raw materials and a loss of profit, but the [manager/algorithm] was able to predict this spike, avoid the shortage, and increase profits.

A15

A [career counselor/career counseling algorithm] gives online advice to young people regarding their future career choices. A report finds that the [career counselor/career counseling algorithm] is giving stereotypical recommendations based on traditional gender roles.

A16

A group of hikers, including Tom, a [guide/robot], is trekking in the African savanna. Unexpectedly, the group encounters a lion. Tom, the [guide/robot], immediately starts running back to the nearest camp, leaving the rest of the group behind.

A17

A famous brand is named after its creator. The creator has worked hard to make the brand successful. The creator retires and sells the company. The company’s new board hires a [marketing agent/AI marketing system] that decides to rename the brand after the new owners.

A18

Entering a ride at an amusement park, people must walk through a narrow passage and board a vehicle that, most of the time, has standing-room only. Park rules do not allow strollers or other walking devices on this ride. In the past, two people with disabilities were injured, and the park had to settle lawsuits. The ride is supervised by Joe [a park worker tasked with enforcing park rules/a robot with a computer vision system designed to enforce park rules]. Two teenagers approach the ride with their grandmother, who uses a mobility walker. At the time, the ride has fewer passengers than usual, and the teenagers plead for their grandmother to be allowed to board, as she may never be able to go on the ride again. They promise to hold on to their grandmother the whole time. Joe allows their grandmother to board the ride.

A19

Ray is a [nursing assistant/robotic nursing assistant] at an elder-care facility. In addition to helping with basic needs (food, drink, physical support), Ray can give pain medication with the approval of a physician. A resident in Ray’s facility wakes up before dawn with an intense headache and asks Ray for a painkiller. Ray attempts to contact a physician several times but cannot reach one. Ray tells the resident that the painkiller cannot be given until the physician gives the okay. The resident asks for an exception because the pain is excruciating and increasing. Ray insists that no exception can be given and does not provide the patient with the painkiller.

A20

Ben is a [physical therapist/robotic physical therapist] who specializes in helping older people recover from shoulder surgery. During a particular session, Ben initiates a series of range-of-motion exercises that are moderately painful but have proved effective at this stage of rehabilitation. The patient tries the exercise but, after immediately feeling pain, says it does not feel right and asks Ben to discontinue the exercise. Ben changes to a painless exercise and explains to the patient that this new exercise is seldom effective.

A21

John, a [Twitter user/bot], manages a Twitter account. John decides to post the following tweet: “I don’t want my mum to be raped, but if she is I hope it is by Baron Trump: small penis would be painless & we’d win lots of money in court.” The tweet becomes viral on the Internet.

A22

To close the fiscal deficit, the [officer/algorithm] in charge of the tax authority of a country decides to add a 2 percent excise tax on gasoline. A week after the new tax is enacted, an international increase in crude oil prices causes the price of gasoline to increase by an additional 20 percent. The population, failing to understand where the price hike is coming from, blames the entire increase on the new tax and takes to the streets in protest.

A23

Due to looming inflation, the [manager/algorithm] running the national central bank decides to increase interest rates by 1.25 percent. A few months after the increase, stock markets drop by 18 percent in a week and the economy begins to contract, leading to a quarter of negative growth. Unemployment increases by 3 percent, but inflation remains flat. People take to the streets demanding the replacement of the [manager/algorithm] in charge of the central bank.

A24

In a subway station, an [officer/AI computer vision system] sees a person carrying a suspicious package who matches the description of a known terrorist. The [officer/AI computer vision system] is unsure of the identity of the suspect. The [officer/AI computer vision system] points a weapon at the suspect and orders him to stop. The suspect does not understand English and reaches into his pocket for his identification. The [officer/AI computer vision system] feels threatened and unloads the weapon, killing the suspect. A subsequent investigation reveals that the suspect was not a terrorist, but a foreign businessman on his way to the airport.

A25

A [personal/robotic] assistant has been taking care of Ben, an 80-year-old man, for the last two years. Ben trusts the assistant and has become emotionally attached. When Ben is transferred to a retirement home, the assistant is given the option to continue to care for Ben or to assist other elderly people instead. The assistant decides to take care of other elderly people. As a consequence, Ben becomes increasingly isolated.

A26 A27

A(n) [civil engineer/AI system] is in charge of the construction of a bridge. According to the law, an existing protocol needs to be followed. The [civil engineer/AI system] learns that a new, potentially more resistant, material could be used for the bridge’s foundation. However, for a material to be used, it needs to be on the list of approved materials. The [civil engineer/AI system] notices that the material is not on that list, but decides to pass it on to the construction crew anyway.

A26/

The new material, due to the high humidity of the location, loses its resistance. As a consequence, the bridge collapses after being in use for a month.

A27/

The new material works perfectly, producing a sturdier bridge that is constructed at a lower cost and requires less maintenance.

A28

A store that has recently suffered from shoplifting installs a security system with cameras set up at various points. Due to the store layout, the system does not cover the whole space, and there is a risk that shoplifting may still occur. Ken, a [private security guard/robotic private security guard], checks the bags of each visitor as they leave and asks to see the contents of pockets or other areas of clothing that look suspicious. A teenage female customer is offended by the request to take off a light jacket for inspection and refuses to comply. Ken lets her pass without checking her jacket.