Cory Doctorow on Nostr: Even worse: when humans *do* exercise discretion to override an algorithm, it's often ...
Even worse: when humans *do* exercise discretion to override an algorithm, it's often to inject the very bias that the algorithm is there to prevent. Sure, the algorithm might give the same recommendation about two similar parents who are facing having their children taken away, but the judge who reviews the recommendations is more likely to override it for a white parent than for a Black one.
17/
Published at
2024-10-30 12:49:32Event JSON
{
"id": "375a749a121bea9000e8da04b68b92fd2136478b40fb302175288f28a4aca062",
"pubkey": "21856daf84c2e4e505290eb25e3083b0545b8c03ea97b89831117cff09fadf0d",
"created_at": 1730292572,
"kind": 1,
"tags": [
[
"e",
"511b8a5c4cb8b39358404139047a6f8b00c6a7ad31d9ee5af293e1b0e53e929c",
"wss://relay.mostr.pub",
"reply"
],
[
"content-warning",
"Long thread/17"
],
[
"proxy",
"https://mamot.fr/users/pluralistic/statuses/113396454018502040",
"activitypub"
]
],
"content": "Even worse: when humans *do* exercise discretion to override an algorithm, it's often to inject the very bias that the algorithm is there to prevent. Sure, the algorithm might give the same recommendation about two similar parents who are facing having their children taken away, but the judge who reviews the recommendations is more likely to override it for a white parent than for a Black one.\n\n17/",
"sig": "ab9f56e5677236707673b53db9d447020697856546808740c9420bb7bbfd31fd1eb583a86f89f04bb6e5a81cadbfce85aab551ccf78ced7ddf2949e01846cb69"
}
