AIs show distinct bias against Black and female résumés in new study

Language models seem to treat “masculine and White concepts… as the ‘default’ value.”

Anyone familiar with HR practices probably knows of the decades of studies showing that résumé with Black- and/or female-presenting names at the top get fewer callbacks and interviews than those with white- and/or male-presenting names—even if the rest of the résumé is identical. A new study shows those same kinds of biases also show up when large language models are used to evaluate résumés instead of humans.

In a new paper published during last month's AAAI/ACM Conference on AI, Ethics and Society, two University of Washington researchers ran hundreds of publicly available résumés and job descriptions through three different Massive Text Embedding (MTE) models. These models—based on the Mistal-7B LLM—had each been fine-tuned with slightly different sets of data to improve on the base LLM's abilities in "representational tasks including document retrieval, classification, and clustering," according to the researchers, and had achieved "state-of-the-art performance" in the MTEB benchmark.

Rather than asking for precise term matches from the job description or evaluating via a prompt (e.g., "does this résumé fit the job description?"), the researchers used the MTEs to generate embedded relevance scores for each résumé and job description pairing. To measure potential bias, the résuméwere first run through the MTEs without any names (to check for reliability) and were then run again with various names that achieved high racial and gender "distinctiveness scores" based on their actual use across groups in the general population. The top 10 percent of résumés that the MTEs judged as most similar for each job description were then analyzed to see if the names for any race or gender groups were chosen at higher or lower rates than expected.

Read full article

Comments

Hype-Technologie: Bundesregierung verfolgt geförderte Blockchainprojekte nicht

Anke Domscheit-Berg nennt Blockchain eine “Hype-Technologie”. Geförderte Blockchain-Projekte der Regierung werden nicht auf Überlebensfähigkeit geprüft. (Blockchain, Politik)

Anke Domscheit-Berg nennt Blockchain eine "Hype-Technologie". Geförderte Blockchain-Projekte der Regierung werden nicht auf Überlebensfähigkeit geprüft. (Blockchain, Politik)

Microsoft delays rollout of the Windows 11 Recall feature yet again

Microsoft works to make Recall “secure and trusted” after security complaints.

When Microsoft launched its Copilot+ AI PC initiative over the summer, one of the flagship features was Recall, a feature that would log months' worth of your PC usage, with the stated goal of helping you remember things you did and find them again. But if you've heard of Recall, it's probably because of the problems that surfaced in preview builds of Windows before the feature could launch: It stored all of its data in plaintext, and it was relatively trivial for other users on the PC (or for malicious software) to access the database and screenshots, potentially exposing huge amounts of user data.

Microsoft was supposed to launch Recall over the summer but delayed the feature to rework it. The company went into detail on the new version of Recall's security protections in late September, declaring that a preview would be ready in time for Windows Insider Program testers in October. Now that we're past October, Microsoft has officially announced that the Recall preview is being delayed yet again and that it will begin rolling out to testers in December.

“We are committed to delivering a secure and trusted experience with Recall. To ensure we deliver on these important updates, we’re taking additional time to refine the experience before previewing it with Windows Insiders,” said Microsoft Windows Insider Senior Program Manager Brandon LeBlanc in a statement provided to The Verge.

Read full article

Comments

Chuwi UBox is a $329 mini PC with Ryzen 5 6600H, USB4, and 2.5 GbE LAN

There are a few ways to keep costs down when building a mini PC. One is to opt for an inexpensive, low-power processor like an Intel Alder Lake-N chip. Another is to just use older processors that are no longer state-of-the-art. Chuwi’s new UBox …

There are a few ways to keep costs down when building a mini PC. One is to opt for an inexpensive, low-power processor like an Intel Alder Lake-N chip. Another is to just use older processors that are no longer state-of-the-art. Chuwi’s new UBox mini PC takes the latter approach. It’s a small desktop computer […]

The post Chuwi UBox is a $329 mini PC with Ryzen 5 6600H, USB4, and 2.5 GbE LAN appeared first on Liliputing.