Regulation and policy

Analytical Versus Clinical Validation: How Software as a Medical Device Earns Trust

The internationally used framework for Software as a Medical Device asks three separate questions: whether the software's output is scientifically linked to the clinical condition, whether the software computes that output correctly, and whether using the output actually helps in real care. A tool can pass one and fail another, so a claim that software is validated means little until you know which of the three was tested.

The internationally used framework for Software as a Medical Device asks three separate questions: whether the software's output is scientifically linked to the clinical condition, whether the software computes that output correctly, and whether using the output actually helps in real care. A tool can pass one and fail another, so a claim that software is validated means little until you know which of the three was tested.

Why validation needs to be split into parts

Software that makes or informs a medical decision is a device in its own right, even without hardware. The internationally used approach, developed through the International Medical Device Regulators Forum and long referenced by the FDA, breaks the question of whether such software can be trusted into three parts. Keeping them separate is the whole point, because a tool can succeed at one and quietly fail at another.

The three parts are a valid clinical association, analytical validation, and clinical validation. Think of them as three different bridges the software has to cross before its output should change what anyone does for a patient.

Valid clinical association: is the output even meaningful

The first question is whether the thing the software measures or predicts has a real, scientifically supported link to the clinical condition it targets. If an app claims a certain skin pattern signals a disease, is that link established in the literature, or merely asserted?

This step borrows from existing science. It asks whether the output could plausibly mean what the developer says it means, before any line of code is judged. Without a valid clinical association, the other two steps are precise answers to the wrong question.

Analytical validation: does the software compute it correctly

Analytical validation turns inward to the software itself. Given input data, does the tool generate its output accurately, reliably, and precisely? If it reads an image, does it measure what it claims to measure, consistently, across the range of inputs it will see in practice?

This is the engineering question. It says nothing yet about whether the output helps a patient. It only confirms that the software does, correctly and repeatably, what it was built to do. The framework treats this as necessary for any medical software, because an output you cannot trust technically is not worth interpreting clinically.

Clinical validation: does using it actually help

The third question is the one people most often assume has been answered when they hear validated. Does using the software's accurate output, in the intended population and the real context of care, achieve the intended purpose? A model can rest on a genuine association and compute flawlessly, yet still fail to improve decisions, because clinicians act on it differently than expected, or the population in practice differs from the one studied.

Clinical validation is where human outcomes enter. The framework expects it for every Software as a Medical Device, scaled to the risk the software carries. Higher-risk tools, whose output drives serious or time-critical decisions, warrant more demanding clinical evidence.

Reading a validated claim without being fooled

When a product says it is clinically validated or clinically proven, treat that as the beginning of a question, not the end. Ask which of the three components was actually tested, and against what. A published sensitivity figure speaks to analytical performance. A study showing that using the tool changed outcomes speaks to clinical validation. They are not interchangeable.

The reason regulators separate the three is that real tools fail at different bridges. A reader who keeps them distinct can tell a genuinely validated tool from one that has cleared only the easy part. That distinction, more than any single accuracy number, is what tells you whether the software has earned a place in a decision.

References and sources

  1. IMDRF, Software as a Medical Device (SaMD): Clinical Evaluation
  2. FDA, Software as a Medical Device (SaMD)
  3. FDA, Global Approach to Software as a Medical Device

How this was researched. This explainer is built from the primary sources listed above and reflects Dr. Tojjar's own critical appraisal of that evidence. It explains and evaluates research and does not provide medical care.

This article is for general education and is not medical or professional advice. For guidance about your own health, talk with a qualified clinician.

Cite this article

Tojjar, D. (2023). Analytical Versus Clinical Validation: How Software as a Medical Device Earns Trust. Dr. Damon Tojjar. https://readingtheevidence.org/articles/samd-analytical-versus-clinical-validation/

Back to all insights