Meaningful human control in shared medical decision making

Research output: Chapter in book/report/conference proceedingContribution to book/anthologyResearchpeer review

Authors

  • Susanne Beck
  • Simon Gerndt
  • David Samhammer
  • Peter Dabrock

External Research Organisations

  • Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU Erlangen-Nürnberg)
View graph of relations

Details

Original languageEnglish
Title of host publicationResearch Handbook on Meaningful Human Control of Artificial Intelligence Systems
PublisherEdward Elgar Publishing Ltd.
Pages131-147
Number of pages17
ISBN (electronic)9781802204131
ISBN (print)9781802204124
Publication statusPublished - 16 Jul 2024

Abstract

Artificial intelligence (AI) applications have become more and more important in the area of medical decision-making. This is accompanied by increasing legal and ethical discussions about responsibility for potential damages. Furthermore, it could be necessary that the humans involved still are - and feel - responsible for the decisions to uphold certain standards. The solution cannot be to attribute individual responsibility if normatively inadequate, especially if the person involved in the shared decision making with AI does not fully understand the process leading towards the suggestions by the machine, or the quality of the data the machine has been trained on. Thus, it is necessary to create shared decision making in a way that it is acceptable to attribute responsibility to the human in the loop. This chapter describes how meaningful human control over the machine can be implemented, reconciling AI-controlled clinical decision support systems with the doctor and patient sovereignty.

Keywords

    AI in medical contexts, Decision support systems, Empirical analysis of MHC, Interdisciplinary projects, Shared decision making

ASJC Scopus subject areas

Cite this

Meaningful human control in shared medical decision making. / Beck, Susanne; Gerndt, Simon; Samhammer, David et al.
Research Handbook on Meaningful Human Control of Artificial Intelligence Systems. Edward Elgar Publishing Ltd., 2024. p. 131-147.

Research output: Chapter in book/report/conference proceedingContribution to book/anthologyResearchpeer review

Beck, S, Gerndt, S, Samhammer, D & Dabrock, P 2024, Meaningful human control in shared medical decision making. in Research Handbook on Meaningful Human Control of Artificial Intelligence Systems. Edward Elgar Publishing Ltd., pp. 131-147. https://doi.org/10.4337/9781802204131.00015
Beck, S., Gerndt, S., Samhammer, D., & Dabrock, P. (2024). Meaningful human control in shared medical decision making. In Research Handbook on Meaningful Human Control of Artificial Intelligence Systems (pp. 131-147). Edward Elgar Publishing Ltd.. https://doi.org/10.4337/9781802204131.00015
Beck S, Gerndt S, Samhammer D, Dabrock P. Meaningful human control in shared medical decision making. In Research Handbook on Meaningful Human Control of Artificial Intelligence Systems. Edward Elgar Publishing Ltd. 2024. p. 131-147 doi: 10.4337/9781802204131.00015
Beck, Susanne ; Gerndt, Simon ; Samhammer, David et al. / Meaningful human control in shared medical decision making. Research Handbook on Meaningful Human Control of Artificial Intelligence Systems. Edward Elgar Publishing Ltd., 2024. pp. 131-147
Download
@inbook{1458ef54908549ddb82752956dc005af,
title = "Meaningful human control in shared medical decision making",
abstract = "Artificial intelligence (AI) applications have become more and more important in the area of medical decision-making. This is accompanied by increasing legal and ethical discussions about responsibility for potential damages. Furthermore, it could be necessary that the humans involved still are - and feel - responsible for the decisions to uphold certain standards. The solution cannot be to attribute individual responsibility if normatively inadequate, especially if the person involved in the shared decision making with AI does not fully understand the process leading towards the suggestions by the machine, or the quality of the data the machine has been trained on. Thus, it is necessary to create shared decision making in a way that it is acceptable to attribute responsibility to the human in the loop. This chapter describes how meaningful human control over the machine can be implemented, reconciling AI-controlled clinical decision support systems with the doctor and patient sovereignty.",
keywords = "AI in medical contexts, Decision support systems, Empirical analysis of MHC, Interdisciplinary projects, Shared decision making",
author = "Susanne Beck and Simon Gerndt and David Samhammer and Peter Dabrock",
note = "Publisher Copyright: {\textcopyright} Giulio Mecacci, Daniele Amoroso, Luciano Cavalcante Siebert, David Abbink, Jeroen van den Hoven and Filippo Santoni de Sio 2024.",
year = "2024",
month = jul,
day = "16",
doi = "10.4337/9781802204131.00015",
language = "English",
isbn = "9781802204124",
pages = "131--147",
booktitle = "Research Handbook on Meaningful Human Control of Artificial Intelligence Systems",
publisher = "Edward Elgar Publishing Ltd.",
address = "United Kingdom (UK)",

}

Download

TY - CHAP

T1 - Meaningful human control in shared medical decision making

AU - Beck, Susanne

AU - Gerndt, Simon

AU - Samhammer, David

AU - Dabrock, Peter

N1 - Publisher Copyright: © Giulio Mecacci, Daniele Amoroso, Luciano Cavalcante Siebert, David Abbink, Jeroen van den Hoven and Filippo Santoni de Sio 2024.

PY - 2024/7/16

Y1 - 2024/7/16

N2 - Artificial intelligence (AI) applications have become more and more important in the area of medical decision-making. This is accompanied by increasing legal and ethical discussions about responsibility for potential damages. Furthermore, it could be necessary that the humans involved still are - and feel - responsible for the decisions to uphold certain standards. The solution cannot be to attribute individual responsibility if normatively inadequate, especially if the person involved in the shared decision making with AI does not fully understand the process leading towards the suggestions by the machine, or the quality of the data the machine has been trained on. Thus, it is necessary to create shared decision making in a way that it is acceptable to attribute responsibility to the human in the loop. This chapter describes how meaningful human control over the machine can be implemented, reconciling AI-controlled clinical decision support systems with the doctor and patient sovereignty.

AB - Artificial intelligence (AI) applications have become more and more important in the area of medical decision-making. This is accompanied by increasing legal and ethical discussions about responsibility for potential damages. Furthermore, it could be necessary that the humans involved still are - and feel - responsible for the decisions to uphold certain standards. The solution cannot be to attribute individual responsibility if normatively inadequate, especially if the person involved in the shared decision making with AI does not fully understand the process leading towards the suggestions by the machine, or the quality of the data the machine has been trained on. Thus, it is necessary to create shared decision making in a way that it is acceptable to attribute responsibility to the human in the loop. This chapter describes how meaningful human control over the machine can be implemented, reconciling AI-controlled clinical decision support systems with the doctor and patient sovereignty.

KW - AI in medical contexts

KW - Decision support systems

KW - Empirical analysis of MHC

KW - Interdisciplinary projects

KW - Shared decision making

UR - http://www.scopus.com/inward/record.url?scp=85206032093&partnerID=8YFLogxK

U2 - 10.4337/9781802204131.00015

DO - 10.4337/9781802204131.00015

M3 - Contribution to book/anthology

AN - SCOPUS:85206032093

SN - 9781802204124

SP - 131

EP - 147

BT - Research Handbook on Meaningful Human Control of Artificial Intelligence Systems

PB - Edward Elgar Publishing Ltd.

ER -