Article Text
Abstract
In recent years, a plethora of high-profile scientific publications has been reporting about machine learning algorithms outperforming clinicians in medical diagnosis or treatment recommendations. This has spiked interest in deploying relevant algorithms with the aim of enhancing decision-making in healthcare. In this paper, we argue that instead of straightforwardly enhancing the decision-making capabilities of clinicians and healthcare institutions, deploying machines learning algorithms entails trade-offs at the epistemic and the normative level. Whereas involving machine learning might improve the accuracy of medical diagnosis, it comes at the expense of opacity when trying to assess the reliability of given diagnosis. Drawing on literature in social epistemology and moral responsibility, we argue that the uncertainty in question potentially undermines the epistemic authority of clinicians. Furthermore, we elucidate potential pitfalls of involving machine learning in healthcare with respect to paternalism, moral responsibility and fairness. At last, we discuss how the deployment of machine learning algorithms might shift the evidentiary norms of medical diagnosis. In this regard, we hope to lay the grounds for further ethical reflection of the opportunities and pitfalls of machine learning for enhancing decision-making in healthcare.
- machine learning
- autonomy
- paternalism
- decision-making
- uncertainty
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Footnotes
Contributors Thomas Grote is the main author of the article. Philipp Berens did write the second section and did comment on the paper’s other parts.
Funding This research was supported by German Research Foundation (DFG, Excellence Cluster ‘Machine Learning—New Perspectives for Sciences’, EXC 2064, project no. 390727645; BE5601/4-1). Philipp Berens was additionally supported by the German Ministry for Education and Research (BMBF, 01GQ1601; 01IS18039A).
Competing interests None declared.
Patient consent for publication Not required.
Provenance and peer review Not commissioned; externally peer reviewed.
Other content recommended for you
- Machine learning in cardiovascular medicine: are we there yet?
- Machine learning in medicine: should the pursuit of enhanced interpretability be abandoned?
- Can medical algorithms be fair? Three ethical quandaries and one dilemma
- Artificial intelligence to diagnose ear disease using otoscopic image analysis: a review
- What is machine learning?
- Applications of artificial intelligence and machine learning in respiratory medicine
- Designing AI for mental health diagnosis: challenges from sub-Saharan African value-laden judgements on mental health disorders
- Applications of machine learning in the chemical pathology laboratory
- Machine learning: a long way from implementation in cardiovascular disease
- How machine learning is embedded to support clinician decision making: an analysis of FDA-approved medical devices