Interdisciplinary Journal of Acute Care

Interdisciplinary Journal of Acute Care

AI-Augmented Self-Assessment in Healthcare: Balancing Accessibility, Accuracy, and Equity

Document Type : Letter to the Editor

Author
Department of Anesthesia, School of Allied Medical Sciences, Tehran University of Medical Sciences, Tehran, Iran
Abstract
In recent years, a growing number of patients have increasingly relied on large language models (LLMs) and other artificial intelligence (AI) tools to interpret their symptoms prior to visiting a clinic or hospital. Advocates assert that these technologies democratize access to health information and empower patients to make informed decisions. They may even alleviate unnecessary visits that burden already strained healthcare systems [1]. However, underlying this promise of empowerment is the risk of misinformation, over- or under-triage, and exacerbated health disparities. 
As AI-mediated self-triage becomes more prevalent, it is imperative to carefully evaluate its contributions against its potential harms. Surveys indicate that up to 40 percent of online health seekers report feeling more confident about subsequent steps after interacting with an AI tool [2]. For individuals in remote areas or those facing long wait times, this reassurance can alleviate anxiety and reduce unnecessary clinic visits, thereby freeing up limited resources for genuinely urgent cases. A 2025 systematic review found that LLMs achieved moderate triage accuracy (57.8–76.0 percent), comparable to—or in some instances surpassing—both standard symptom-assessor applications and layperson judgment (47.3–62.4 percent) [3]. However, these studies often rely on retrospective datasets and controlled scenarios, which may not fully capture real-world variability in patient presentations or the influence of user interface design on decision-making.
From the clinician’s perspective, systematic comparisons reveal that while some AI models match human performance in identifying common conditions, they struggle with atypical presentations and complex multi-morbidity. For instance, GPT-4 placed the correct diagnosis within its top three suggestions approximately 42 percent of the time, yet identified the correct primary diagnosis only 22 percent of the time [4]. A reassuring output of “likely viral infection” in a patient with evolving myocarditis may delay critical intervention, whereas an overly cautious algorithm might recommend emergency care for benign issues, contributing to overcrowded emergency departments and diverting attention from truly critical patients.
Health system administrators have noted that AI-driven self-triage can reshape care pathways, sometimes for the better. Integrating AI tools into telemedicine platforms can direct high-risk cases directly to on-call providers, thereby shortening the time to treatment [5]. However, without robust oversight, these same tools could create backlogs when false positives trigger unnecessary referrals. To maximize the benefits, administrators must monitor AI output metrics, track referral completion rates, and ensure seamless handoffs between virtual assessments and in-person care.
Ethical considerations further complicate this issue. AI models trained on datasets that under-represent certain ethnic groups or socioeconomic strata may yield biased recommendations, deepening existing health inequities. Patients with low health literacy or limited English proficiency may misinterpret AI guidance and trust it as a substitute for professional evaluation. Clear disclaimers, culturally sensitive interfaces, and multimodal explanations (text, audio, and graphics) are essential for mitigating these risks and fostering digital health equity.
The efficacy of AI-driven self-assessment is contingent upon its judicious implementation. It is imperative to invest in prospective validation studies encompassing diverse populations, establish regulatory frameworks that ensure transparency in model performance, and educate both patients and healthcare providers regarding the capabilities and limitations of these tools. Interdisciplinary collaboration, involving nurses, physicians, data scientists, ethicists, and patient advocates, is essential for designing AI-enhanced care pathways that improve safety, efficiency, and equity.
Consequently, we urge all stakeholders in the health sciences to take action: clinicians should rigorously evaluate and monitor AI recommendations; health information technologists should develop interfaces that emphasize clarity and inclusivity; administrators should integrate AI into workflows with appropriate safeguards; educators should incorporate AI literacy into professional training; policymakers should establish guidelines that balance innovation with patient protection; and patients should actively engage by critically appraising AI outputs, participating in shared decision-making, and reporting inaccuracies to refine these systems. By uniting our expertise and prioritizing patient welfare, we can leverage the potential of AI self-assessment while mitigating its possible drawbacks.
Keywords

1. Chand RD, Rajnish R, Chandra H, Tiwari P, Pradhan PK. Building an AI-Driven Symptom Checker Using Python Django for Enhanced Telemedicine Services. In2025 International Conference on Inventive Computation Technologies (ICICT) 2025 Apr 23 (pp. 1704-1711). IEEE. doi: https://doi.org/10.1109/ICICT64420.2025.11005056  
2. Ayo-Ajibola O, Davis RJ, Lin ME, Riddell J, Kravitz RL. Characterizing the Adoption and Experiences of Users of Artificial Intelligence–Generated Health Information in the United States: Cross-Sectional Questionnaire Study. Journal of Medical Internet Research. 2024 Aug 14;26:e55138. doi: https://doi.org/10.2196/55138  
3. Kopka M, von Kalckreuth N, Feufel MA. Accuracy of online symptom assessment applications, large language models, and laypeople for self––triage decisions. npj Digital Medicine. 2025 Mar 25;8(1):178. doi: https://doi.org/10.1038/s41746-025-01566-6  
4. Ríos-Hoyo A, Shan NL, Li A, Pearson AT, Pusztai L, Howard FM. Evaluation of large language models as a diagnostic aid for complex medical cases. Frontiers in Medicine. 2024 Jun 20;11:1380148. doi: https://doi.org/10.3389/fmed.2024.1380148  
5. Pundkar A, Gadkari C, Patel A, Kumar A. Transforming emergency medicine with artificial intelligence: From triage to clinical decision support. Multidisciplinary Reviews. 2025 Apr 4;8(10):2025285-. doi: https://doi.org/10.31893/multirev.2025285  
Volume 6, Issue 1
June 2025
Pages 65-66

  • Receive Date 28 April 2025
  • Revise Date 01 May 2025
  • Accept Date 17 June 2025