General-purpose large language model (LLM)-based chatbots are increasingly used by clinicians to discuss medical problems, including antibiotic prescribing. Their use creates an unprecedented setting for clinical reasoning in which diagnostic and therapeutic thinking becomes dynamically shared between human and machine. Here, we propose a theoretical framework, intended for subsequent empirical assessment, around the concept of shared reasoning fragility, defined as the potential instability arising from the interaction between clinician reasoning and the chatbot’s opaque, association-based processes, which are structurally different from classical human reasoning. The theoretical framework is based on the conceptual argument that, while the black box dilemma is often discussed for classification-oriented clinical decision support systems with an emphasis on explainability versus external validation, chatbot-assisted practice introduces a distinct problem: chatbots can accompany clinicians throughout the entire reasoning pathway rather than being consulted only at the final decision point. In the present perspective, we argue more explicitly that the fragility of this continuous co-reasoning primarily stems from its novelty and pervasiveness. Using strictly illustrative examples in antibiotic prescribing, we suggest the theoretical possibility that fluent and convincing outputs may redirect attention, mask omissions in work-up, and subtly shift hypothesis selection during shared clinical reasoning processes. While it is important to stress that our framework is purely theoretical and thus cannot be confirmed at the present stage, our considerations are intended to motivate the required quantitative research to confirm or refute shared reasoning fragility, measure its extent, and evaluate downstream implications for patient care.

A Theoretical Framework for Shared Reasoning Fragility in Clinician-Chatbot Interactions Through the Example of Antibiotic Prescribing

Giacobbe, Daniele Roberto;Marelli, Cristina;Muccio, Marco;Guastavino, Sabrina;Murgia, Ylenia;Mora, Sara;Signori, Alessio;Rosso, Nicola;Giacomini, Mauro;Campi, Cristina;Piana, Michele;Bassetti, Matteo
2026-01-01

Abstract

General-purpose large language model (LLM)-based chatbots are increasingly used by clinicians to discuss medical problems, including antibiotic prescribing. Their use creates an unprecedented setting for clinical reasoning in which diagnostic and therapeutic thinking becomes dynamically shared between human and machine. Here, we propose a theoretical framework, intended for subsequent empirical assessment, around the concept of shared reasoning fragility, defined as the potential instability arising from the interaction between clinician reasoning and the chatbot’s opaque, association-based processes, which are structurally different from classical human reasoning. The theoretical framework is based on the conceptual argument that, while the black box dilemma is often discussed for classification-oriented clinical decision support systems with an emphasis on explainability versus external validation, chatbot-assisted practice introduces a distinct problem: chatbots can accompany clinicians throughout the entire reasoning pathway rather than being consulted only at the final decision point. In the present perspective, we argue more explicitly that the fragility of this continuous co-reasoning primarily stems from its novelty and pervasiveness. Using strictly illustrative examples in antibiotic prescribing, we suggest the theoretical possibility that fluent and convincing outputs may redirect attention, mask omissions in work-up, and subtly shift hypothesis selection during shared clinical reasoning processes. While it is important to stress that our framework is purely theoretical and thus cannot be confirmed at the present stage, our considerations are intended to motivate the required quantitative research to confirm or refute shared reasoning fragility, measure its extent, and evaluate downstream implications for patient care.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1313881
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? 0
social impact