Representation of intensivists' race/ethnicity, sex, and age by artificial intelligence: a cross-sectional study of two text-to-image models - Gisselbaek, M.; Suppan, M.; Minsart, L.; Koselerli, E.; Nainan Myatra, S.; Matot, I.; Barreto Chang, O. L.; Saxena, S.; Berger-Estilita, J. (Crit Care, 2024)
BACKGROUND: Integrating artificial intelligence (AI) into intensive care practices can enhance patient care by providing real-time predictions and aiding clinical decisions. However, biases in AI models can undermine diversity, equity, and inclusion (DEI) efforts, particularly in visual representations of healthcare professionals. This work aims to examine the demographic representation of two AI text-to-image models, Midjourney and ChatGPT DALL-E 2, and assess their accuracy in depicting the demographic characteristics of intensivists. METHODS: This cross-sectional study, conducted from May to July 2024, used demographic data from the USA workforce report (2022) and intensive care trainees (2021) to compare real-world intensivist demographics with images generated by two AI models, Midjourney v6.0 and ChatGPT 4.0 DALL-E 2. A total of 1,400 images were generated across ICU subspecialties, with outcomes being the comparison of sex, race/ethnicity, and age representation in AI-generated images to the actual workforce demographics. RESULTS: The AI models demonstrated noticeable biases when compared to the actual U.S. intensive care workforce data, notably overrepresenting White and young doctors. ChatGPT-DALL-E2 produced less female (17.3% vs 32.2%, p < 0.0001), more White (61% vs 55.1%, p = 0.002) and younger (53.3% vs 23.9%, p < 0.001) individuals. While Midjourney depicted more female (47.6% vs 32.2%, p < 0.001), more White (60.9% vs 55.1%, p = 0.003) and younger intensivist (49.3% vs 23.9%, p < 0.001). Substantial differences between the specialties within both models were observed. Finally when compared together, both models showed significant differences in the Portrayal of intensivists. CONCLUSIONS: Significant biases in AI images of intensivists generated by ChatGPT DALL-E 2 and Midjourney reflect broader cultural issues, potentially perpetuating stereotypes of healthcare worker within the society. This study highlights the need for an approach that ensures fairness, accountability, transparency, and ethics in AI applications for healthcare.
Keywords: journalArticle; *Artificial Intelligence/statistics & numerical data/trends; Adult; Age Factors; Artificial intelligence (AI); Bias; Cross-Sectional Studies; Demographic representation; Equity and inclusion (DEI); Ethnicity/statistics & numerical data; Faculty Development Program and participated as an investigator for the clinical; Female; Humans; Intensive Care (ESAIC) Board of Directors and has received speaker fees from; Intensive care; Male; Medtronic(R). The remaining authors declare that the research was conducted in the; Medtronic(R)/Merck(R). JB-E is a member of the European Society of Anesthesiology and; Middle Aged; Protection Acts and the study complied with the Declaration of Helsinki [37]. The; Racial Groups/statistics & numerical data; Swissethics-University of Bern, Switzerland. The researchers followed the Data; United States; absence of any commercial or financial relationships that could be construed as a; applicable. Competing interests OB received funding from the Harold Amos Medical; epidemiology (STROBE) reporting guideline. [38] Consent for publication Not; ethical committee waiver (Req-2024-00531) was obtained from the; potential conflict of interest; study adhered to the strengthening the reporting of observational studies in; trial OLIVER from Medtronic(R). SS has received speaker's fees from