Guardrail failure: Companies are losing revenue and customers due to AI bias – TechRepublic

New survey finds that 80% of U.S. firms found problems despite having bias monitoring or algorithm tests already in place.

Tech companies in the U.S. and the U.K. haven’t done enough to prevent bias in artificial intelligence algorithms, according to a new survey from Data Robot. These same organizations are already feeling the impact of this problem as well in the form of lost customers and lost revenue.
DataRobot surveyed more than 350 U.S. and U.K.-based technology leaders to understand how organizations are identifying and mitigating instances of AI bias. Survey respondents included CIOs, IT directors, IT managers, data scientists and development leads who use or plan to use AI. The research was conducted in collaboration with the World Economic Forum and global academic leaders.
In the survey, 36% of respondents said their organizations have suffered due to an occurrence of AI bias in one or several algorithms. Among those companies, the damage was significant: 
Respondents report that their organizations’ algorithms have inadvertently contributed to a wide range of bias against several groups of people:
In addition to measuring the state of AI bias, the survey probed attitudes about regulations. Surprisingly, 81% of respondents think government regulations would be helpful to address two particular components of this challenge: defining and preventing bias. Beyond that, 45% of tech leaders worry that those same regulations increase costs and create barriers to adoption. The survey also identified another complexity to the issue: 32% of respondents said they are concerned that a lack of regulation will hurt certain groups of people. 
SEE: 5 questions to ask about your AI or IoT project
Emanuel de Bellis, a professor at the Institute of Behavioral Science and Technology, University of St. Gallen, said in a press release that the European Commisison’s proposal for AI regulation could address both of these concerns. 
“AI provides countless opportunities for businesses and offers means to battle some of the most pressing issues of our time,” de Bellis said. “At the same time, AI poses risks and legal issues including opaque decision-making (the black-box effect), discrimination (based on biased data or algorithms), privacy and liability issues.”   
Companies are aware of the risk of bias in algorithms and have attempted to put some protections in place. Seventy-seven percent of respondents said they had an AI bias or algorithm test in place before determining that bias was happening anyway. More organizations in the U.S. (80%) had AI bias monitoring or algorithm tests in place prior to bias discovery than organizations in the U.K. (63%). 
At the same time, U.S. tech leaders are more confident in their ability to detect bias with 75% of American respondents saying they could spot bias, as compared with 56% of U.K. respondents saying the same. 
Here are the steps companies are taking now to detect bias:
Eighty-four percent of respondents saidtheir organizations are planning to invest more in AI bias prevention initiatives in the next 12 months. According to the survey, these actions will include spending more money to support model governance, hiring more people to manage AI trust, creating more sophisticated AI systems and producing more explainable AI systems.
We deliver the top business tech news stories about the companies, the people, and the products revolutionizing the planet. Delivered Daily
Veronica Combs is a senior writer at TechRepublic. For more than 10 years, she has covered technology, healthcare, and business strategy. In addition to her writing and editing expertise, she has managed small and large teams at startups and establis…
Quick glossary: Metaverse
OneDrive Cloud Usage Policy
iCloud Usage Policy
Oracle Linux checklist: What to do after installation

Connect with Chris Hood, a digital strategist that can help you with AI.

Leave a Reply

Your email address will not be published. Required fields are marked *

© 2022 AI Caosuo - Proudly powered by theme Octo