Terrific piece by and colleagues…Dissecting racial bias in an algorithm used to manage the health of populations… #bias #healthdisparities #disparities #bigdata
New paper w/ , , and Christine Vogeli out today in . Does a predictive algorithm widely used for population health management exhibit racial bias? Short answer: YES. Full Article: THREAD (1/8) cc:
1/3: Our recent paper finds large racial bias in an important health care algorithm. We want to help fix the problem. If you’re at a health system or a manufacturer that wants to know more or do better – contact us at [email protected]
A widely used #AI algorithm that predicts health risk exemplifies automated racial bias and collaborators
This is an amazingly (terrifying) example of how the proprietary algorithm of a single organization can shape population health. #racializedorganizations Dissecting racial bias in an algorithm used to manage the health of populations
A nationally deployed healthcare algorithm shows significant racial bias in its predictions of the health risks of black patients, researchers report in Science. In light of the findings, the authors are working with the developer to reduce bias.
An algorithm that a major medical center used to identify patients for extra care has been shown to be racially biased, according to a paper published in Science. The IEEE Spectrum article has a nuanced discussion. paper article
A nationally deployed healthcare algorithm shows significant racial bias in its predictions of the health risks of black patients, researchers report in Science. In light of the findings, the authors are working with the developer to reduce bias.
"Bias occurs because the #algorithm uses health costs as a proxy for health needs. Less $ is spent on Black patients who have the same level of need, & the algorithm thus falsely concludes that Black patients are healthier than equally sick White patients"
Wow. Stunning paper on racial bias in health algorithms: And magnificent Perspective on the historical contect by : .
Dissecting racial bias in an algorithm used to manage the health of populations
Surrogate outcomes (proxies) as a source of racial bias in algorithmic decision-making: Using predictions of future health care costs in decisions can reinforce existing bias in access to care
I am not surprised by this in the least and it’s a shame that such issues are only identified when third parties conduct a comprehensive forensic analysis.
Racial bias in a widely used algorithm ->Black patients assigned the same level of risk by the algorithm are sicker than White patients. This racial bias reduces the number of Black patients identified for extra care by more than half.
This one isn't a policy report or blog, but it's the study that has stuck with me demonstrating the risks we all need to consider when using data. This wonderfully constructed study demonstrated racial bias in an algorithm managing care in the US
What an important article elucidating how technological advancements and increase use of algorithms have unintended consequences on minority communities. Dissecting racial bias in an algorithm used to manage the health of populations
"Less money is spent on Black patients who have the same level of need, and the algorithm thus falsely concludes that Black patients are healthier than equally sick White patients." article: author interview:
Not only is 'the amount of money saved' is the wrong metric, it is also a harmful one - you end up with a racist systems like the one explored here.
At Grand Rounds, Ziad Obermeyer presents his Science article on racial bias in health care management algorithms. “The data that we have are not biological but social.”
You should also all have a look at the algorithmic bias paper and accompanying Perspective this week:
ICYMI: A health care algorithm reflects underlying racial bias in society.
An algorithm widely used in US hospitals to allocate health care to patients has been systematically discriminating against black people. Original study ⁩ ⁦
Important work. "Obermeyer et al. find evidence of racial bias in one widely used algorithm, such that Black patients assigned the same level of risk by the algorithm are sicker than White patients" (and they contacted algorithm manufacturer to discuss)
Algorithm widely used in the USA to screen patients is less likely to refer black people than white people who are equally sick for treatment:
“...racial bias reduces the number of Black patients identified for extra care by more than half. Less money is spent on Black patients who have the same level of need, and the algorithm thus falsely concludes that Black patients are healthier.”
❝Dissecting racial bias in an algorithm used to manage the health of populations❞ If the algorithm learns to predict health needs from examples of health costs + less money spent on black patients, then algorithm underpredicts needs of black patients
13/ This isn't theoretical. Here are 2 papers (one by ’s & me ; other by ’s ) with real-world examples of how AI-bias can lead to unethical decisions. Important to be cautious w/ AI
We’ve got to make sure we’re building fair models, models that don’t use proxies and shortcuts that short-change our populations. highlights great recent work by at on health algorithm biases, in
Dissecting racial bias in an algorithm used to manage the health of populations via et al
Have you seen the article in #Science? - Dissecting racial bias in an algorithm used to manage the health of populations I'm waiting for the #globalhealth version. #tek4healthequity
Brilliant & thoughtful research in 'dissecting racial bias' in an established population health algorithm. The article reads like a detective novel identifying the mechanism through which bias has arisen and how it's potentially fixable
Dissecting racial bias in an algorithm used to manage the health of populations via et al
Really great article in about how commercial algorithms in US healthcare used health costs as proxy (surprise!) for health need and seriousness of ill health, leading to inbuilt algorithmic racial bias.
Fascinating new paper illustrates how histories of discrimination are inscribed in apparently innocent data series on which algorithms are built. 'Dissecting racial bias in an algorithm used to manage the health of populations"
Dissecting racial bias in an algorithm used to manage the health of populations
Racial bias in algorithm used to manage health
Concerning new study raising a call to action: "..widely used (health care) algorithm, exhibits significant racial bias...remedying this disparity would increase the percentage of Black patients receiving additional help from 17.7 to 46.5%."
Dissecting racial bias in an algorithm used to manage the health of populations
Important study on how we can USE DATA BETTER #datasaveslives Dissecting racial bias in an algorithm used to manage the health of populations
Dissecting racial bias in an algorithm used to manage the health of populations . #fljcnlt
MIND. BLOWN. Dissecting racial bias in an algorithm used to manage the health of populations
Dissecting racial bias in an algorithm used to manage the health of populations
Thus, judgments contain biases. 's thinking in 2010: Debiasing tools look a lot like algorithms. The more rules we can put in place, the better we can protect us from ourselves. But: new study demonstrates algorithms contain biases too: 2/10
Dissecting racial bias in an algorithm used to manage the health of populations #race #ethnicity #bias
It seems like this article could be brought into conversation with this one and this one ?
Healthcare algorithm used across America has dramatic racial biases, by via #racism #Medicare4All