Fully Open Meditron: Building Auditable Clinical AI from the Ground Up

Paper: 2605.16215 Authors: Xavier Theimer-Lienhard, Mushtaha El-Amin, Fay Elhassan, Sahaj Vaidya, Victor Cartier-Negadi, David Sasu, Lars Klein, Mary-Anne Hartley Categories: cs.AI, cs.CL

The Gap

Medical AI systems need to be auditable—clinicians must trace how a model arrived at its recommendation. Current “open” medical LLMs (like Med-PaLM, MedGemma) release model weights but hide the training data sources, curation decisions, and generation pipelines. You can inspect the final artifact but not the manufacturing process. This opacity blocks regulatory approval, clinical validation, and scientific reproducibility. No fully open medical LLM pipeline exists—one where every step from raw data to final model is documented and reproducible.

Problem: Clinical AI lacks auditability
   |
   v
Assumption: Transparency requires exposing entire pipeline, not just weights
   |
   v
Method: Build end-to-end open pipeline (data + curation + training + eval)
   |
   v
Evidence: Physician-validated corpus + decontaminated training + calibrated eval
   |
   v
Conclusion: Fully open models match/exceed closed performance with full auditability

The Increment

One sentence: Before this paper, medical LLMs were black boxes with open weights; after, we have a complete recipe—data sources, curation rules, training code, and validation protocol—that anyone can audit and reproduce.

Core Mechanism

The pipeline has three layers. First, the corpus layer unifies eight public medical QA datasets into a normalized conversational format, then adds three synthetic extensions: exam-style questions, guideline-grounded QA from 46,469 clinical practice guidelines, and clinical vignettes. Each synthetic sample is vetted by clinicians. Second, the training layer enforces system-wide decontamination (removing test set leakage), resamples teacher-generated answers using gold labels to prevent error propagation, and applies supervised fine-tuning. Third, the evaluation layer uses an LLM-as-a-judge protocol over expert-written vignettes, calibrated against 204 human raters and validated by a four-physician panel.

Raw Data Sources (8 public datasets + guidelines)
   |
   v
[Normalization] --> Conversational format
   |
   v
[Synthetic Expansion] --> Exam QA + Guideline QA + Vignettes
   |                              |
   v                              v
[Clinician Vetting] <------ [Gold-label Resampling]
   |
   v
[Decontamination] --> Remove test leakage
   |
   v
[SFT Training] --> Fine-tuned model
   |
   v
[LLM-as-Judge Eval] <------ Calibrated with 204 human raters
   |
   v
[Physician Panel Validation] --> Final model

Think of this as building a restaurant with a glass kitchen. Most medical AI kitchens are closed—you taste the dish (model output) but never see the ingredients (training data), the recipe (curation rules), or the cooking process (training pipeline). Fully Open Meditron installs glass walls everywhere. The ingredient sourcing (corpus layer) documents where every piece of data came from and how it was cleaned. The recipe book (training layer) specifies exact steps: how to prevent cross-contamination (decontamination), how to correct mistakes in prep work (gold-label resampling), and how to cook (SFT). The taste testing (evaluation layer) isn’t just “does it taste good?”—it’s calibrated against professional food critics (physicians) and validated by a panel of chefs. If a health inspector (regulator) or another chef (researcher) walks in, they can trace every decision from farm to table.

Key Concepts

• Decontamination: When you train a model, you split data into training and test sets. If test questions leak into training data (even paraphrased), the model memorizes answers instead of learning reasoning. Decontamination is the process of scanning the entire training corpus for any overlap with test benchmarks and removing it. Think of it like ensuring exam questions aren’t in the textbook students study from. This paper does system-wide decontamination—checking not just the base datasets but also synthetic expansions and teacher-generated samples. Without this, performance numbers are inflated and meaningless.

• Gold-label resampling: When generating synthetic training data using a teacher model (like GPT-4), the teacher sometimes produces wrong answers. If you train on these errors, the student model inherits them. Gold-label resampling means: after the teacher generates an answer, check it against the known correct answer (gold label). If they match, keep it. If they diverge, regenerate or discard. It’s like having a teaching assistant grade practice problems—if they mark something wrong, you don’t let students study that version; you correct it first.

• LLM-as-a-judge calibration: Using an LLM to evaluate another LLM’s outputs is fast but risky—the judge might have biases or misalign with human preferences. Calibration means: collect human ratings on a sample of outputs, then tune the judge’s prompts and scoring until its ratings correlate strongly with human ratings. This paper calibrated against 204 human raters and validated with a physician panel. It’s like training a wine-scoring algorithm by having it rate thousands of wines alongside expert sommeliers until its scores predict expert consensus.

Framework Shift

Before (open-weight models):        After (fully open pipeline):

[Model Weights]                     [Raw Data Sources]
      |                                     |
   (black box)                        [Curation Rules]
      |                                     |
   [Output]                          [Training Code]
                                            |
                                      [Validation Protocol]
                                            |
                                         [Model]
                                            |
                                         [Output]

Auditable: Weights only             Auditable: Entire chain

From opacity to transparency, the core shift is making the manufacturing process inspectable, not just the product.

Expert Assessment

Problem choice: Real and urgent. Regulatory bodies (FDA, EMA) are blocking medical AI deployment precisely because they can’t audit training pipelines. This isn’t a manufactured gap—it’s the bottleneck preventing clinical adoption. The problem sits at the intersection of AI safety, medical regulation, and open science, making it strategically important.

Method maturity: Solid engineering, not a novel algorithm. The contribution is integration—taking known techniques (decontamination, synthetic data generation, LLM-as-judge) and applying them rigorously across the entire pipeline. The gold-label resampling is clever but not groundbreaking. The real work is in the discipline: clinician vetting, multi-stage validation, and documentation. This is what production-grade open science looks like.

Experimental integrity: Baselines are fair. Comparing against MedGemma (a strong closed baseline) and showing wins on both LLM-judge and human-calibrated metrics is convincing. The 204-rater calibration study is expensive and rare—most papers skip this. One concern: the LLM-judge uses GPT-4, which may favor models trained on OpenAI-generated data. The physician panel validation mitigates this, but it’s worth noting. Decontamination is thorough, though no decontamination is perfect—there’s always risk of paraphrased leakage.

Writing quality: The paper front-loads contributions clearly, but the methods section is dense. The synthetic data generation pipeline (Section 3.2) would benefit from a flowchart—right now it’s a wall of text. The evaluation section (4.2) is excellent: clear protocol, calibration details, and limitations discussion. If I were revising, I’d add a “Reproducibility Checklist” appendix with exact commands and dataset versions.

Verdict: strong accept — Addresses a critical barrier to clinical AI deployment with rigorous execution and full transparency, setting a new standard for medical LLM research.

Takeaways

Decontamination as a first-class citizen: Most projects treat decontamination as an afterthought. This paper shows it must be system-wide—checking base data, synthetic expansions, and teacher outputs. Steal this: build decontamination into your data pipeline from day one, not as a post-hoc audit.

Gold-label resampling for synthetic data: When using teacher models to generate training data, always validate against ground truth and regenerate on mismatch. This prevents error propagation and is cheap compared to the cost of training on corrupted data.

Calibrated LLM-as-judge: If you’re using LLM evaluation, calibrate it against human raters on a held-out set. Report the correlation coefficient. Without calibration, LLM-judge scores are just vibes.

Physician-in-the-loop validation: For any high-stakes domain (medical, legal, financial), have domain experts validate a sample of outputs. The four-physician panel here isn’t just for optics—it catches failure modes automated metrics miss.

Full pipeline release: If you’re building domain-specific models, release the entire stack: data sources, curation scripts, training code, and evaluation protocol. This paper proves you can do this without sacrificing performance. The reproducibility dividend is enormous.