The rising misuse of AI in {medical} research

Day 4 12:50 Ground en Science
Dec. 30, 2025 12:50-13:30
Artificial intelligence (AI) is increasingly used in medical research, influencing how data are analyzed and how findings are presented. While some applications have led to genuine progress, others rely on overstated claims, unsuitable methods, or even manipulated data and outcomes. This talk examines the growing misuse of AI-related terminology and techniques in the scientific literature. By discussing what is actually meant by “AI” and related concepts, it will consider how inflated expectations, methodological misuse, and deliberate falsification can undermine the credibility and reproducibility of {medical} research.

This talk examines how AI is currently used - and increasingly misused - in medical research. It begins with examples where AI methods have achieved genuine advances and others where they have clearly failed. Between these extremes lies a wide area where the term “AI” is often applied inconsistently or without sufficient methodological justification. I will discuss what is actually meant by AI, machine learning, and related concepts, and clarify where these approaches can be useful and where they are not. The talk focuses on three main forms of misuse: the selling argument - using the label “AI” to make research appear more sophisticated; the misuse of method - applying AI techniques where they offer no real benefit; and simple falsification. To illustrate these issues, I will present a recent example from my own research on a biomarker for chronic pain, showing how such problems can arise and how difficult they are to flag and correct within the scientific and publishing landscape. The talk concludes with reflections on how the research community can promote more transparent, critical, and responsible uses of AI.

Speakers of this event