The Financial Times highlights research led by Marzyeh Ghassemi (MIT Jameel Clinic), which demonstrates how large language models exhibit biases that affect patient care recommendations for women and ethnic minorities.
The research suggested “some patients could receive much less supportive guidance based purely on their perceived race by the model”, said Marzyeh.
“My hope is that we will start to refocus models in health on addressing crucial health gaps, not adding an extra per cent to task performance that the doctors are honestly pretty good at anyway,” she added.