Over 50 top Artificial Intelligence researchers on Wednesday announced a boycott of KAIST, South Korea’s top university, after it opened what they called an AI weapons lab with one of South Korea’s largest companies.
The researchers, based in 30 countries, said they would refrain from visiting KAIST, hosting visitors from the university, or cooperating with its research programmes until it pledged to refrain from developing AI weapons without “meaningful human control”.
KAIST, which opened the centre in February with Hanwha Systems, one of two South Korean makers of cluster munitions, responded within hours, saying it had “no intention to engage in development of lethal autonomous weapons systems and killer robots.”
University President Sung-Chul Shin said the university was “significantly aware” of ethical concerns regarding Artificial Intelligence, adding, “I reaffirm once again that KAIST will not conduct any research activities counter to human dignity including autonomous weapons lacking meaningful human control.”
The university said the new Research Centre for the Convergence of National Defence and Artificial Intelligence would focus on using AI for command and control systems, navigation for large unmanned undersea vehicles, smart aircraft training and tracking and recognition of objects.
Toby Walsh, the professor at the University of New South Wales in Sydney who organised the boycott, said the university’s quick response was a success, but he needed to speak with all those who signed the letter before calling off the boycott.
“KAIST has made two significant concessions: not to develop autonomous weapons and to ensure meaningful human control,” he said, adding that the university’s response would add weight to UN discussions taking place next week on the overall issue.
Walsh said it remained unclear how one could establish meaningful human control of an unmanned submarine – one of the launch projects – when it was under the sea and unable to communicate.
In an open letter announcing the boycott, the researchers had warned: “If developed, autonomous weapons will … permit war to be fought faster and at a scale great than ever before. They will have the potential to be weapons of terror.”
They cited effective bans on previous arms technologies and urged KAIST ban any work on lethal autonomous weapons, and to refrain from AI uses that would harm human lives.
AI is the field in computer science that aims to create machines able to perceive the environment and make decisions.
The letter, also signed by top experts on deep learning and robotics, was released ahead of next Monday’s meeting in Geneva by 123 UN member countries on the challenges posed by lethal autonomous weapons, which critics describe as “killer robots”.
Walsh told Reuters there were many potential good uses of robotics and Artificial Intelligence in the military, including removing humans from dangerous task such as clearing minefields.
“But we should not hand over the decision of who lives or dies to a machine. This crosses a clear moral line,” he said. “We should not let robots decide who lives and who dies.”