News Daily

The Times

Australia

  • Written by The Conversation
AI may be exposing jobseekers to discrimination. Here’s how we could better protect them

Artificial intelligence (AI) tools are rapidly transforming the world of work – not least, the process of hiring, managing and promoting employees.

According to the most recent Responsible AI Index, 62% of Australian organisations used AI in recruitment “moderately” or “extensively” in 2024.

Many of these systems classify, rank and score applicants, evaluating their personality, behaviour or abilities. They decide – or help a recruiter decide – who moves to the next stage in a hiring process and who does not.

But such systems pose distinct and novel risks of discrimination. They operate at a speed and scale that cannot be replicated by a human recruiter. Job seekers may not know they are being assessed by AI and the decisions of these systems are inscrutable.

My research study examined this problem in detail.

I found the use of AI systems by employers in recruitment – for CV screening, assessment and video interviewing – poses serious risks of discrimination for women, older workers, job seekers with disability and those who speak English with an accent. Legal regulation is yet to catch up.

The rise of artificial interviewers

To conduct my research, I interviewed not only recruiters and human resources (HR) professionals, but also AI experts, developers and career coaches. I also examined publicly available material provided by two prominent software vendors in the Australian market.

I found the way these AI screening systems are used by employers risks reinforcing and amplifying discrimination against marginalised groups.

Woman conducting job interview on laptop
AI tools are increasingly being used to augment recruiting processes. insta_photos/Shutterstock

Discrimination may be embedded in the AI system via the data or the algorithmic model, or it might result from the way the system is used by an organisation.

For example, the AI screening system may not be accessible to or validated for job seekers with disability.

One research participant, a career coach, explained that one of his neurodivergent clients, a top student in his university course, cannot get through personality assessments.

He believes the student’s atypical answers have resulted in low scores and his failure to move to the next stage in recruitment processes.

Lack of transparency

The time limits for answering questions may not be sufficient or communicated to candidates.

One participant, also a career coach, explained that not knowing the time limit for responding to questions had resulted in some of her clients being “pretty much cut off halfway through” their answers.

Another stated:

[…] there’s no transparency a lot of the time about what the recruitment process is going to be, so how can [job seekers with disability] […] advocate for themselves?

New barriers to employment

AI screening systems can also create new structural barriers to employment. Job seekers need a phone and secure internet connection, and must possess digital literacy skills, to undertake an AI assessment.

These systems may result in applicants deciding not to put themselves forward for positions or dropping out of the process.

Close up of woman's hands using laptop
It isn’t always clear to job seekers how AI systems have been used in the recruitment process. fizkes/Shutterstock

The protections we have

Existing federal and state anti-discrimination laws apply to discrimination by employers using AI screening systems, but there are gaps. These laws need to be clarified and strengthened to address this new form of discrimination.

For example, these laws could be reformed so that there is a presumption in any legal challenge that an AI system has discriminated against a candidate, putting the burden on employers to prove otherwise.

Currently, the evidential burden of proving such discrimination falls on job seekers. They are not well placed to do this, as AI screening systems are complex and opaque.

Any privacy law reforms should also include a right to an explanation when AI systems are used in recruitment.

The newly elected Albanese government must also follow through on its plan to introduce mandatory “guardrails” for “high risk” AI applications, such as those used in recruitment.

Safeguards must include a requirement that training data be representative and that the systems be accessible to people with disability and subject to regular independent audits.

We also urgently need guidelines for employers on how to comply with these laws when they use new AI technologies.

Should AI hiring systems be banned?

Some groups have called for a ban on the use of AI in employment in Australia.

In its Future of Work report, the House of Representatives Standing Committee recommended that AI technologies used in HR for final decision-making without human oversight be banned.

There is merit in these proposals – at least, until appropriate safeguards are in place and we know more about the impacts of these systems on equality in the Australian workplace.

As one of my research participants acknowledged:

The world is biased and we need to improve that but […] when you take that and put it into code, the risk is that no one from a particular group can ever get through.

Read more https://theconversation.com/ai-may-be-exposing-jobseekers-to-discrimination-heres-how-we-could-better-protect-them-256789

Split Corrugated Conduit for Flexible Cable Protection

For wiring assemblies in vehicles, machinery and equipment, choosing suitable cable protection helps keep cables organised and reduces direct contact with surrounding parts. Mojak Plastics supplies plastic tubing and conduit options for different installation needs, and split corrugated conduit can... Read more

Trailers Melbourne Buyers Can Compare: When Box Trailers Make Sense

For many homeowners, businesses and tradespeople, trailers Melbourne customers use every week need to be versatile enough for changing loads. A box trailer can be particularly useful because its enclosed sides help contain cargo while providing a straightforward loading area... Read more

Bottle Label Printing That Balances Design and Readability

Product labels need to attract attention while making information easy to find and understand. On a bottle, the available space may be limited by the container’s shape, so every design decision matters. Bottle label printing should account for visual hierarchy... Read more

Office Cleaning Melbourne: Planning a Consistent Workplace Routine

Businesses looking for office cleaning Melbourne need a plan that reflects the way their workplace operates. A clean office supports day-to-day organisation, helps shared spaces remain presentable and gives employees and visitors a more orderly environment. Eco Green Cleaning Management... Read more

Pinboard Solutions for Offices, Schools and Shared Information Spaces

Why a Pinboard Remains Useful A pinboard provides a simple way to display information that needs to remain visible without being rewritten. Lawdex supplies fabric and cork options for offices, schools, staff areas and other environments. A pinboard can be used... Read more

Retractable Hose Reel: A Practical Guide To Choosing The Right Hose Storage

A retractable hose reel can make hose storage more organised, accessible and practical in workshops, commercial facilities, service areas and other working environments. Instead of leaving a hose coiled across the floor or requiring staff to manually wind it after... Read more