Systems for diagnosis, prognosis and imaging have repeatedly been deployed or promoted on the strength of performance that proved fragile under independent testing. A model that performs well in the hospital where it was born has proven only one thing: that it works at home. Consider the most instructive failure in recent clinical AI. The …
In 2019, a research team led by the physician and economist Ziad Obermeyer reverse-engineered a commercial algorithm already running quietly across the United States health system. The tool, sold by Optum, helped decide which patients — out of a population of roughly 200 million a year — would be flagged for extra medical attention. To …
A medical algorithm must not confuse cost with health Leer más »
In an internal review that later became public, IBM’s Watson for Oncology was shown a patient much like thousands treated every day: a 65-year-old man with lung cancer who was also suffering from severe bleeding. The system recommended bevacizumab — a drug that carries an explicit warning against use in patients with severe hemorrhage, precisely …
When AI sounds certain but should say “I do not know” Leer más »
Organisations increasingly use automated decision-making systems (ADMS) to inform decisions that affect humans and their environment. While the use of ADMS can improve the accuracy and efficiency of decision-making processes, it is also coupled with ethical challenges. Unfortunately, the governance mechanisms currently used to oversee human decision-making often fail when applied to ADMS.
The OECD launched the Artificial Intelligence and the Future of Skills project to develop a programme that could assess the capabilities of AI and robotics and their impact on education and work. This report represents the first step in developing the methodological approach of the project.
Documentation is key – design decisions in AI development must be documented in detail, potentially taking inspiration from the field of risk management. There is a need to develop a framework for large-scale testing of AI effects, beginning with public tests of AI systems, and moving towards real-time validation and monitoring. Governance frameworks for decisions in AI development need to be clarified, including the questions of post-market surveillance of product or system performance. Certification of AI ethics expertise would be helpful to support professionalism in AI development teams. Distributed responsibility should be a goal, resulting in a clear definition of roles and responsibilities as well as clear incentive structures for taking in to account broader ethical concerns in the development of AI systems.
The book focuses on machine learning models for tabular data (also called relational or structured data) and less on computer vision and natural language processing tasks. Reading the book is recommended for machine learning practitioners, data scientists, statisticians, and anyone else interested in making machine learning models interpretable.
