Artificial intelligence systems are used to determine who gets public services and decide who has a chance to be recruited for a job, the UN rights chief said, warning that data collected can be compromised, out of date and even discriminatory.
The United Nations High Commissioner for Human Rights Michelle Bachelet on Wednesday called for a moratorium on the sale and use of artificial intelligence (AI) systems that threaten human rights until adequate safeguards are in place to ensure the technology will not be abused.
“We cannot afford to continue playing catch-up regarding AI – allowing its use with limited or no boundaries or oversight, and dealing with the almost inevitable human rights consequences after the fact,” Bachelet said in a press release.
The UN human rights office released a report on Wednesday warning of the risks of AI technologies, and emphasising that while AI can serve as a force for good, it can also cause catastrophic effects if used irresponsibly.
“The complexity of the data environment, algorithms and models underlying the development and operation of AI systems, as well as intentional secrecy of government and private actors are factors undermining meaningful ways for the public to understand the effects of AI systems on human rights and society,” the report states.
Bachelet, who is the UN’s human rights chief, stressed that AI applications that do not comply with international human rights law must be banned.
“The power of AI to serve people is undeniable, but so is AI’s ability to feed human rights violations at an enormous scale with virtually no visibility. Action is needed now to put human rights guardrails on the use of AI, for the good of all of us,” Bachelet stressed.
AI’s abilities to conduct profiling and automate decision-making – as well as its other uses – threaten myriad human rights. It can affect the “rights to health, education, freedom of movement, freedom of peaceful assembly and association, and freedom of expression,” the UN human rights office warned.
“AI systems are used to determine who gets public services, decide who has a chance to be recruited for a job, and of course they affect what information people see and can share online,” the high commissioner said.
The report expresses deep concern over some countries and the private sector adopting AI applications without first studying the myriad risks of the technology.
There have already been some dangerous blunders, the UN office said, noting cases where individuals were denied social security benefits or arrested because of flawed facial recognition.
AI systems often collect, share, merge and analyse data in opaque ways. The information that AI collects can be compromised, out of date and even discriminatory.
“The risk of discrimination linked to AI-driven decisions – decisions that can change, define or damage human lives – is all too real,” Bachelet said. “This is why there needs to be systematic assessment and monitoring of the effects of AI systems to identify and mitigate human rights risks.”