Showing posts with label biases. Show all posts
Showing posts with label biases. Show all posts

Sunday, February 18, 2024

IT body proposes that AI pros get leashed and licensed to uphold ethics; The Register, February 15, 2024

 Paul Kunert, The Register; IT body proposes that AI pros get leashed and licensed to uphold ethics

"Creating a register of licensed AI professionals to uphold ethical standards and securing whistleblowing channels to call out bad management are two policies that could prevent a Post Office-style scandal.

So says industry body BCS – formerly the British Computer Society – which reckons licenses based on an independent framework of ethics would promote transparency among software engineers and their bosses.

"We have a register of doctors who can be struck off," said Rashik Parmar MBE, CEO at BCS. "AI professionals already have a big role in our life chances, so why shouldn't they be licensed and registered too?"...

The importance of AI ethics was amplified by the Post Office scandal, says the BCS boss, "where computer generated evidence was used by non-IT specialists to prosecute sub postmasters with tragic results."

For anyone not aware of the outrageous wrongdoing committed by the Post Office, it bought the bug-ridden Horizon accounting system in 1999 from ICL, a company that was subsequently bought by Fujitsu. Hundreds of local Post Office branch managers were subsequently wrongfully convicted of fraud when Horizon was to blame."

Friday, May 20, 2022

Federal officials caution employers on using AI in hiring; FCW, May 12, 2022

 Natalie Alms, FCW; Federal officials caution employers on using AI in hiring

"The growing use of artificial intelligence and other software tools for hiring, performance monitoring and pay determination in the workplace is compounding discriminiation against people with disabilities, federal civil rights officials say.

Artificial intelligence can be deployed to target job ads to certain potential applicants, hold online job interviews, assess the skills of job applicants and even decide if an applicant meets job requirements. But the technology can discriminate against applicants and employees with disabilities.

On Thursday, the Equal Employment Opportunity Commission and the Department of Justice put employers on alert that they're responsible for not using AI tools in ways that discriminate and inform employees of their rights, agency officials told reporters."

Friday, February 4, 2022

Where Automated Job Interviews Fall Short; Harvard Business Review (HBR), January 27, 2022

Zahira Jaser, Dimitra Petrakaki, Rachel Starr, and Ernesto Oyarbide-MagaƱa, Harvard Business Review (HBR) ; Where Automated Job Interviews Fall Short

"The use of artificial intelligence in HR processes is a new, and likely unstoppable, trend. In recruitment, up to 86% of employers use job interviews mediated by technology, a growing portion of which are automated video interviews (AVIs).

AVIs involve job candidates being interviewed by an artificial intelligence, which requires them to record themselves on an interview platform, answering questions under time pressure. The video is then submitted through the AI developer platform, which processes the data of the candidate — this can be visual (e.g. smiles), verbal (e.g. key words used), and/or vocal (e.g. the tone of voice). In some cases, the platform then passes a report with an interpretation of the job candidate’s performance to the employer.

The technologies used for these videos present issues in reliably capturing a candidate’s characteristics. There is also strong evidence that these technologies can contain bias that can exclude some categories of job-seekers. The Berkeley Haas Center for Equity, Gender, and Leadership reports that 44% of AI systems are embedded with gender bias, with about 26% displaying both gender and race bias. For example, facial recognition algorithms have a 35% higher detection error for recognizing the gender of women of color, compared to men with lighter skin.

But as developers work to remove biases and increase reliability, we still know very little on how AVIs (or other types of interviews involving artificial intelligence) are experienced by different categories of job candidates themselves, and how these experiences affect them, this is where our research focused. Without this knowledge, employers and managers can’t fully understand the impact these technologies are having on their talent pool or on different group of workers (e.g., age, ethnicity, and social background). As a result, organizations are ill-equipped to discern whether the platforms they turn to are truly helping them hire candidates that align with their goals. We seek to explore whether employers are alienating promising candidates — and potentially entire categories of job seekers by default — because of varying experiences of the technology."