Tackling algorithmic bias and promoting transparency in health datasets: the STANDING Together consensus recommendations.
Alderman JE., Palmer J., Laws E., McCradden MD., Ordish J., Ghassemi M., Pfohl SR., Rostamzadeh N., Cole-Lewis H., Glocker B., Calvert M., Pollard TJ., Gill J., Gath J., Adebajo A., Beng J., Leung CH., Kuku S., Farmer L-A., Matin RN., Mateen BA., McKay F., Heller K., Karthikesalingam A., Treanor D., Mackintosh M., Oakden-Rayner L., Pearson R., Manrai AK., Myles P., Kumuthini J., Kapacee Z., Sebire NJ., Nazer LH., Seah J., Akbari A., Berman L., Gichoya JW., Righetto L., Samuel D., Wasswa W., Charalambides M., Arora A., Pujari S., Summers C., Sapey E., Wilkinson S., Thakker V., Denniston A., Liu X.
Without careful dissection of the ways in which biases can be encoded into artificial intelligence (AI) health technologies, there is a risk of perpetuating existing health inequalities at scale. One major source of bias is the data that underpins such technologies. The STANDING Together recommendations aim to encourage transparency regarding limitations of health datasets and proactive evaluation of their effect across population groups. Draft recommendation items were informed by a systematic review and stakeholder survey. The recommendations were developed using a Delphi approach, supplemented by a public consultation and international interview study. Overall, more than 350 representatives from 58 countries provided input into this initiative. 194 Delphi participants from 25 countries voted and provided comments on 32 candidate items across three electronic survey rounds and one in-person consensus meeting. The 29 STANDING Together consensus recommendations are presented here in two parts. Recommendations for Documentation of Health Datasets provide guidance for dataset curators to enable transparency around data composition and limitations. Recommendations for Use of Health Datasets aim to enable identification and mitigation of algorithmic biases that might exacerbate health inequalities. These recommendations are intended to prompt proactive inquiry rather than acting as a checklist. We hope to raise awareness that no dataset is free of limitations, so transparent communication of data limitations should be perceived as valuable, and absence of this information as a limitation. We hope that adoption of the STANDING Together recommendations by stakeholders across the AI health technology lifecycle will enable everyone in society to benefit from technologies which are safe and effective.