---

As the global body charged with protecting human rights, the United Nations—especially the UN Human Rights Council and the Office of the High Commissioner for Human Rights (OHCHR)—has a unique role to play in ensuring AI is developed and used in ways that are fair, inclusive, and just.

The United Nations must declare AI equity a Sustainable Development Goal (SDG) by 2035, backed by binding audits for member states. The stakes are high. A 2024 Stanford study warns that if AI bias is left unchecked, 45 million workers could lose access to fair hiring by 2030, and 80 percent of those affected would be in developing countries.

The Promise—and Peril—of AI

At its core, AI is about using computer systems to solve those problems or perform those tasks that us to use human intelligence. Algorithms drive the systems that make these possible—sets of instructions that help machines make sense of the world and act accordingly.

But there’s a catch: algorithms are only as fair as the data they are trained on and the humans who designed them. When the data reflects existing social inequalities, or when developers overlook diverse perspectives, the result is biased AI. In other words, AI that discriminates.

Take, for example, facial recognition systems that perform poorly on people with darker skin tones. Or hiring tools that favor male candidates because they’re trained on data from past hires in male-dominated industries.

Or a LinkedIn verification system that can only verify NFC-enabled national passports that the majority of Africans don’t yet possess. These are more than technical glitches; they are human rights issues.

What the UN Has Already Said

The UN is not starting from scratch on this. The OHCHR has already sounded the alarm. In its 2021 report on the right to privacy in the digital age, the OHCHR warned that poorly designed or unregulated AI systems can lead to violations of human rights, including discrimination, loss of privacy, and threats to freedom of expression and thought.

The report asked powerful questions we must keep asking:

• ● How can we ensure that algorithms don’t replicate harmful stereotypes?
• ● Who is responsible when automated decisions go wrong?
• ● Can we teach machines our values? And if so, whose values?

These are very vital, practical questions that go to the heart of how AI will shape our societies and who will benefit or suffer as a result, and I commend the UN for conceptualizing these questions.

UNESCO, another UN agency, has also taken a bold step by adopting the Recommendation on the Ethics of Artificial Intelligence, the first global standard-setting instrument of its kind. Their Recommendation emphasizes the need for fairness, accountability, and transparency in AI development, and calls for banning AI systems that pose a threat to human rights.

This is a good start. But the real work is just beginning.

The Danger of Biased Data

A major driver of AI discrimination remains biased data. Many AI systems are trained on historical data; data that often reflects past inequalities. If a criminal justice algorithm is trained on data from a system that has historically over-policed Black communities, it will likely continue to do so.

Even well-meaning developers can fall into this trap. If the teams building AI systems lack diversity, they may not recognize when an algorithm is biased or may not consider how a tool could impact marginalized communities.

That’s why it’s not just about better data. It’s also about better processes, better people, and better safeguards.

Take the ongoing case with Workday as an example.

When AI Gets It Wrong: 2024’s Most Telling Cases

In one of the most significant AI discrimination cases moving through the courts, the plaintiff alleges that Workday’s popular artificial intelligence (AI)-based applicant recommendation system violated federal antidiscrimination laws because it had a disparate impact on job applicants based on race, age, and disability.

Judge Rita F. Lin of the US District Court for the Northern District of California ruled in July 2024 that Workday could be an agent of the employers using its tools, which subjects it to liability under federal anti-discrimination laws. This landmark decision means that AI vendors, not just employers, can be held directly responsible for discriminatory outcomes.

In another case, the University of Washington researchers found significant racial, gender, and intersectional bias in how three state-of-the-art large language models ranked resumes. The models favored white-associated names over equally qualified candidates with names associated with other racial groups.

In 2024, a University of Washington study investigated gender and racial bias in resume-screening AI tools. The researchers tested a large language model’s responses to identical resumes, varying only the names to suggest different racial and gender identities.

The financial impact is staggering. A 2024 DataRobot survey of over 350 companies revealed: 62% lost revenue due to AI systems that made biased decisions, proving that discriminatory AI isn’t just a moral failure—it’s a business disaster. It’s too soon for an innovation to result in such losses.

Time is running out. A 2024 Stanford study estimates that if AI bias is not addressed, 45 million workers could be pushed out of fair hiring by 2030, with 80 percent of those workers living in developing countries. The UN needs to take action now before these predictions turn into reality.

What the UN Can—and Must—Do

To prevent AI discrimination, the UN must lead by example and work with governments, tech companies, and civil society to establish global guardrails for ethical AI.

Here’s what that could look like:

• 1. Develop Clear Guidelines: The UN should push for global standards on ethical AI, building on UNESCO’s Recommendation and OHCHR’s findings. These should include rules for inclusive data collection, transparency, and human oversight.
• 2. Promote Inclusive Participation: The people building and regulating AI must reflect the diversity of the world. The UN should set up a Global South AI Equity Fund to provide resources for local experts to review and assess tools such as LinkedIn’s NFC passport verification. Working with Africa’s Smart Africa Alliance, the goal would be to create standards together that make sure AI is designed to benefit communities that have been hit hardest by biased systems. This means including voices from the Global South, women, people of color, and other underrepresented groups in AI policy conversations.
• 3. Require Human Rights Impact Assessments: Just like we assess the environmental impact of new projects, we should assess the human rights impact of new AI systems—before they are rolled out.
• 4. Hold Developers Accountable: When AI systems cause harm, there must be accountability. This includes legal remedies for those who are unfairly treated by AI. The UN should create an AI Accountability Tribunal within the Office of the High Commissioner for Human Rights to look into cases where AI systems cause discrimination.
• This tribunal should have the authority to issue penalties, such as suspending UN partnerships with companies that violate these standards, including cases like Workday.
• 5. Support Digital Literacy and Rights Education: Policy makers and citizens need to understand how AI works and how it might impact their rights. The UN can help promote digital literacy globally so that people can push back against unfair systems.

6. Mandate Intersectional Audits: AI systems should be required to go through intersectional audits that check for combined biases, such as those linked to race, disability, and gender. The UN should also provide funding to organizations to create open-source audit tools that can be used worldwide.

The Road Ahead

AI is not inherently good or bad. It is a tool, and like any tool, its impact depends on how we use it. If we are not careful, AI could lengthen problem-solving time, deepen existing inequalities, and create new forms of discrimination that are harder to detect and harder to fix.

But if we take action now—if we put human rights at the center of AI development—we can build systems that uplift, rather than exclude.

Ahead of the UN General Assembly meeting in September, the United Nations must declare AI equity a Sustainable Development Goal (SDG) by 2035, backed by binding audits for member states. The time for debate is over; the era of ethical AI must begin now.

The United Nations remains the organization with the credibility, the platform, and the moral duty to lead this charge. The future of AI—and the future of human dignity—may depend on it.

Chimdi Chukwukere is a researcher, civic tech co-founder, and advocate for digital justice. His work explores the intersection of technology, governance, and social justice. He holds a Masters in Diplomacy and International Relations from Seton Hall University and has been published at Politics Today, International Policy Digest, and the Diplomatic Envoy.

Gift Nwammadu is a Mastercard Foundation Scholar at the University of Cambridge, where she is pursuing an MPhil in Public Policy with a focus on inclusive innovation, gender equity, and youth empowerment. A Youth for Sustainable Energy Fellow and Aspire Leader Fellow, she actively bridges policy and grassroots action. Her work has been published by the African Policy and Research Institute addressing systemic barriers to inclusive development.

IPS UN Bureau

  Source

---

Advances in artificial intelligence and machine learning (consisting of neural networks), for instance, enable machines to process new information in real-time. As federated learning becomes more widespread, machine learning models can collaborate without the need to share sensitive data, thereby enhancing privacy and security.

These and other recent technological developments will find applications in sectors such as healthcare, where advanced algorithms can support personalized diagnosis and treatment. New and emerging technologies, including nanotechnology and human enhancement technology, have implications for international peace and security too.

Amidst the highest number of armed conflicts since 1946, military technologies are evolving rapidly in both damage potential and distribution.

Artificial intelligence and other technologies are fast expanding the autonomous capabilities of weapons and accelerating the spread of digital dis- and misinformation. At the same time, if present trends persist, only a few countries may dominate this space, in terms of both technological innovation and “setting-the-rules” for their governance.

Against the backdrop of disruptive global forces that create new challenges, risks, and opportunities for development, security, and the global order itself, the need for effective “tech-governance” – including the engagement of all countries, big and small, through existing global institutions – has never been more urgent.

In short, effective tech-governance helps countries to employ common principles (including safety and transparency), codes of practice, and regulation to implement shared values and protect basic human rights.

Successful governance of new and emerging technologies at the global level will require the UN’s 193 member states to not only adopt new, non-binding normative frameworks (such as the recently endorsed Global Digital Compact), but also to build upon them by pursuing targeted innovations in global governance.

In the Future of International Cooperation Report 2024, produced by the Doha Forum, the Stimson Center, and the Global Institute for Strategic Research, we call for assembling an International Scientific Panel on AI (ISPAI) that extends beyond the Global Digital Compact’s limited description focused on promoting “scientific understanding through evidence-based impact, risk and opportunity assessments.”

Feeding into current intergovernmental deliberations in New York co-facilitated by the Governments of Spain and Costa Rica, we believe the ISPAI should be tasked with producing knowledge products and increasing awareness of AI risk, principles, and regulations for policy-makers.

Modeled on the Intergovernmental Panel on Climate Change, the ISPAI’s ultimate objective could be to understand and address the impact of emerging digital information technologies on the world’s social, economic, political, and natural systems.

The extraordinary pace of AI innovation requires an agile and fast-paced approach to scientific assessment by continually evaluating the technology’s evolving capabilities and ramifications.

A community of practice through an AI Frontier Collaborative would further assist the ISPAI with a new international public-private partnership for expanding access to – as well as investing in – AI technology from leading private sector AI developers, where much of the innovation happens outside the public realm.

Such an initiative would build upon public-private conversations at the recent AI Action Summit in Paris and complement the Global Digital Compact’s commitment to stand-up a Global Dialogue on AI Governance, designed to engage the 118 UN Member States (primarily from the Global South) that do not belong to any of the current seven major international AI governance initiatives.

Additionally, the International Scientific Panel on AI could function as a subsidiary of, and with direct administrative support from, an International Artificial Intelligence Agency (IA2), as elaborated in this forum.

Advising the UN General Assembly and Security Council, the IA2 would boost visibility, advocacy, and resource-mobilization for global AI regulation, while monitoring, evaluation, and reporting on AI industry safeguards. It could further help countries to combat AI-enabled disinformation and the resulting misinformation that can fuel violence and aid terrorist and criminal organizations.

Critically, a scientific panel (like the ISPAI) requires an agile policy platform (like the IA2), as a chief beneficiary of ISPAI’s analysis and recommendations. This will help to ensure its policy relevance and impact, as well as to serve as a central coordination mechanism for AI and related cybertech expertise across the UN system.

Artificial intelligence and other new and emerging technologies make possible powerful new tools for problem-solving. But they also raise serious governance challenges, including in the spheres of global development and security. Effective regulation to maximize their benefits and minimize risks requires the astute combination of advanced knowledge, multistakeholder approaches, and an agile policy interface.

To prevent unbridled competition – dominated by only a select few large companies backed-up by equally large and powerful countries – from leaving everyone worse off, let alone precipitating a serious lose-lose confrontation, we must continuously update global governance tools and mechanisms to keep pace with technological advances.

Improving their effective global management will continue to usher in benefits for potentially billions of people worldwide while, simultaneously, mitigating technological risks.

Mubarak Al-Kuwari is Executive Director of the Doha Forum; Richard Ponzio is Director of the Global Governance, Justice, and Security Program and a senior fellow at the Stimson Center;

Mohamed Ali Chihi is Executive Director of the Global Institute for Strategic Research.

IPS UN Bureau

  Source