New policy encourages AI technology to augment, rather than replace, doctors’ decision-making

The use of artificial intelligence (AI) in clinical care has the potential to transform health care delivery, but it should not replace physician decision-making, the American College of Physicians (ACP) said in a new policy document released Monday titled “Artificial Intelligence in Health Care Delivery.” Annals of Internal MedicineThe paper offers recommendations on the ethical, scientific and clinical factors surrounding the use of AI, and states that AI tools and systems should augment human intelligence rather than replace it.

“AI has the potential to help solve some of the issues currently plaguing the healthcare industry, including physician shortages, burnout, and administrative burdens,” said ACP President Isaac O. Opole, MBChB, Ph.D, MACP. “However, we must fully understand the impact of any technology we deploy to ensure we realize maximum benefit while minimizing harm to patients.”

To avoid risks and ensure best practices, the ACP recommends limiting AI-enabled technology to a supporting role in clinical decision-making. The ACP notes that when this technology is used for clinical decision-making, it is better to call it “augmented” intelligence, because ideally the tools should be used to assist clinicians, not replace them.

Tools must be developed, tested, and used transparently, prioritizing privacy, clinical safety, and effectiveness. The use of technology must actively work to reduce, rather than exacerbate, disparities, ensuring a fair and just health system.

ACP recommends that a coordinated federal strategy is needed to ensure accountability and oversight of AI-powered medical tools, including oversight of AI by government and non-government regulatory agencies. Tools should be designed to reduce the burden on physicians and other clinicians who support patient care while adhering to unwavering principles of medical ethics.

Additionally, the ACP recommends that training on AI in healthcare be provided at all levels of medical education to ensure that AI tools are operated safely. Physicians should not only be able to use the technology but also be able to make appropriate clinical decisions independently, even if AI decision support is no longer available. Finally, efforts to quantify the environmental impact of AI must continue, and mitigation of that impact should be considered.

“AI is already impacting the medical world, and ACP is excited about what it will mean for the future of healthcare,” said Dr. Opole.

“This transformative technology has great potential to be used to improve clinical practice and promote health equity. As we integrate AI into healthcare practice, it is essential that we remain cognizant of the clinical and ethical implications of AI technology, as well as its impact on patient health.”