Backcover | EYES |

Articles by the Director

External validation is not a bureaucratic detail

Article 003 · 11 July 2026

External validation is not an administrative formality in medical artificial intelligence. It is the point at which a model leaves the environment in which it was built and meets the clinical world it claims to serve. A system may perform acceptably inside its development setting, with familiar data, familiar definitions and familiar institutional habits, and still fail when applied to another hospital, another population, another workflow or another clinical threshold. In medicine, this difference is not a technical inconvenience. It is the difference between a controlled experiment and a decision-support instrument placed near patients, physicians and institutional protocols.

The history of clinical AI already contains enough warnings. Predictive systems have been deployed or promoted with insufficient evidence that their performance would survive outside their original conditions. Models for sepsis, diagnosis, prognosis and imaging have repeatedly shown how fragile apparent performance can become when tested independently. A high score reported by a developer is not the same as robust clinical validity. A retrospective validation is not the same as safe prospective use. A model that works in one cohort does not automatically work in another. The medical system is not a laboratory container; it is a changing field of patients, data quality, professional judgement, local practice and institutional pressure.

External validation matters because clinical data are not neutral raw material. They are produced by real institutions, with their own coding habits, measurement gaps, demographic composition, access inequalities and clinical routines. A model may learn local patterns that look predictive but do not represent general medical truth. It may learn the behaviour of a hospital rather than the biology of a disease. It may learn documentation practices, alert thresholds, treatment delays, missing values or administrative conventions. If such a model is transferred without independent testing, the error does not remain inside the model. It enters the clinical workflow and may influence what is seen, what is ignored and what is acted upon.

A serious architecture for medical AI must therefore treat external validation as a condition of use, not as a decorative appendix after deployment. Before a model supports clinical decisions, it must be tested against populations, definitions and conditions that were not used to build it. Its calibration, failure modes, false negatives, false positives and domain limits must be visible. When those limits are unknown, the correct status is not confidence. It is caution. Medical AI should not be allowed to borrow trust from the language of innovation while postponing the evidence that would justify that trust.

The question is not whether artificial intelligence can help medicine. It can. The question is whether it can do so without pretending that internal performance is enough. In high-risk clinical environments, validation is not paperwork. It is the bridge between computation and responsibility. Without that bridge, a model may be impressive, publishable and commercially attractive, but it is not yet ready to stand beside the physician.

Previous articles
  1. Article 002 · 11 July 2026
    A medical algorithm must not confuse cost with health
  2. Article 001 · 11 July 2026
    When AI sounds certain but should say “I do not know”

In our sights : MONTREAL AI ETHICS INSTITUTE

Now in its sixth cycle, this edition of the State of AI Ethics Report comes to you with a wide array of topics and contributions from leading lights in the field. For the first time, we have a Spanish text contribution in the report in our endeavor to produce multilingual content for the community to consume. We’ve added a new chapter on Trends that highlights subtle and not so subtle changes taking place in the AI ethics landscape. This one is a must-read for anyone who is planning on bring AI ethics meaningfully into their organizations, or pursuing research and looking for ideas on which areas to make an impact in.  PDF.

The State of AI Ethics Report (Volume 6). January 30, 2022 by MAIEI.

Look at our academic supplement The Bible of AI ™ OpenScience

A conceptual and algebraically framework that did not exist up until then in its morphology, was developed. What is more, it is pioneer on its implementation in the area of Artificial Intelligence (AI) and it was started up in laboratory, on its structural aspects, as a fully operational model. At qualitative level, its greatest contribution to AI is applying the conversion or transduction of parameters obtained by ternary logic (multi-valued systems) and associating them with an image. This image will be analysed by means of a residual artificial network ResNet34, to warn us of an intrusion. The field of application of this framework includes everything from smartwatches, tablets, and PC’s to the home automation based on the KNX standard.

Framework based on parameterized images on ResNet to identify intrusions in smartwatches or other related devices

Opening your eyes… with Nature & NASA


Last glimpse

Artificial intelligence as a legal entity and its civil responsibility within Europe | By the Director



Share this on: