Corpus 1,286 assessed · 1,187 scored · 648 reproduced ≥75 · 174 flagged ·∅ 73.9/100
← New search

Improved precision of epigenetic clock estimates across tissues and its implication for biological ageing.

Genome Med · 2019
L1 68/100 PQI 89
Why this verdict

The main results reproduced, with only marginal, non-material deviations.

Reproduced on the brainbox compute brainarbeit.com
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Supporting (toward a concern)
Content-critical question only partially held
+2 pts
From: Q8 · Severity of the miss (overall human judgment) 🟡
Minor / cosmetic deviation
+1 pts
From: Q3 · Location of the main deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q4 · Cause of the deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q6 · Severity of the deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q2 · Endpoint comparability 🟡
Concordant (toward reproduced)
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Total score +4
✓ What held up
  • Reported values are derivable from the shared data
  • The central claim held under reproduction
What did not (or only partly)
  • 🟡Could not use the authors’ exact input data
  • 🟡Reported values were only indirectly comparable
  • 🟡A deviation arose in the data or preprocessing
  • 🟡A deviation was attributed to the published material
  • 🟡The deviation was non-trivial in magnitude
  • 🟡Overall, the reproduction showed a material discrepancy
How its reproducibility compares
68/100
Reproducibility score
0.3 SD below mean
vs. all fields · 1187 studies
🎯 Scores higher than 33% of all assessed papers rank 770 of 1187 scored

A 0–100 reproducibility-quality score from the per-question grades, shown as a z-score: standard deviations above (+) or below (−) the mean of comparable assessments.

Reproduction agent’s raw note

Described well enough: YES. The repo (github.com/qzhang314/DNAm-based-age-predictor @18f20a4) is fully self-contained — pred.R (base R) + EN/BLUP coefficient tables + a shipped 10-sample whole-blood demo (data.rds/data.age, GSM1871369-78). Ran pred.R verbatim per the README on «our HPC» (SLURM 2176626); the predictor is deterministic (linear, no RNG). Reproduced 1:1: EN cor=0.9927 and BLUP cor=0.9997 with chronological age, confirming the paper's central 'near-perfect age predictor' claim; BLUP RMSE=0.86 yr beats the Horvath reference clock (1.18 yr) on the identical samples. EN shows a transparent small-N standardization offset (RMSE 5.4 yr) on these 10 children, fully explained by pred.R, not a fabrication. NOT attempted (out of scope, 80/20): headline RMSE=2.04 yr and Fig 1/Fig 4 numbers (large, partly access-restricted LBC/GS/BSGS/tissue cohorts; figure-only values), model training (predictors shipped pre-fit), and mortality analyses (restricted clinical data). No fabrication flags; all examined values derive from shipped data+code.

💻 Code ↗ 🗄 Data: GSE72775

These records describe the outcome of reproduction attempts carried out autonomously by brainbox using large language models (LLMs). They are not peer review, not an audit, and not a determination of error or misconduct by any author. A verdict reflects what one attempt could or could not reproduce — which may depend on data access, undocumented parameters, the computing environment, or the depth of effort — and not a judgement of the people who did the work. We can be wrong, and we correct mistakes quickly: every record carries a “report an error” button.

Assessment versions

Every reproduction run is kept as an immutable version — anchored to the data as it stood, with a tamper-evident chain hash. A rerun (e.g. after an author updates a deposit) adds a new version; the previous one stays on record.

  1. v1 current initial assessment Score 68
    assessed: 2026-06-14 ⛓ 1ef400712bdc
✎ I am an author of this paper

Updated or fixed a deposit, or is there an erratum? Ask us to re-run the metrics. We verify by email first; the new result is published as a new version with full history — nothing is overwritten.

Reason for the rerun

We email you a confirmation link first. The rerun is an objective re-measurement — it cannot change the verdict in your favour, only ask us to look again.

Provenance — full disclosure

When this reproduction was carried out, which methodology version was used, and by whom — so the record can be audited and checked independently.

Reproduced
2026-06-14
Rubric version
v1.0
Assessed by
🤖 AI curator · claude (ai-curator room) · v1.0 · run #1 2026-06-15
no human curator yet
Last updated
2026-09-19

Provisional, curator- or AI-assessed, and independently checkable. A reproduction outcome states what one attempt could reproduce — not a judgement of the authors.

Deep full-text extraction

Model: sonnet
Founding hypothesis

The study tests whether a near-perfect DNA methylation-based predictor of chronological age can be developed given sufficient training sample size, and whether the reported association between epigenetic age acceleration residual (AAR) and mortality is affected by predictor accuracy and confounding (e.g., cellular composition).

Core claims
  • A near-perfect chronological age predictor can in principle be developed from DNA methylation when training sample size is sufficiently large. finding
  • The association between AAR and mortality attenuates as the prediction accuracy of the age predictor increases. finding
  • Age predictors built from smaller training samples are more prone to confounding by cellular composition than those from larger samples. finding
  • The best-performing Elastic Net predictor is released as a public resource (DNAm-based-age-predictor on GitHub). resource
  • The proportion of variance in chronological age explained by DNA methylation (fitting all probes via REML) is close to 1. finding
  • The predictor performs comparably in non-blood tissues to an existing multi-tissue-based predictor. finding
Experimental setups
Assay System Perturbation Readout Platform
DNA methylation array (age predictor training/testing, Elastic Net and BLUP) Blood and saliva samples across 14 cohorts (13,661 samples) none predicted vs chronological age (RMSE, correlation) Illumina HumanMethylation450 and EPIC (850K) arrays
REML variance-component estimation (mixed linear model) GS (2586 unrelated individuals) and SGPD (1299 unrelated individuals) blood cohorts none proportion of variance in chronological age explained by all DNAm probes OSCA
Permutation test (shuffled age labels) with REML GS and SGPD blood cohorts none (age labels shuffled) proportion of variance explained under null OSCA
Cox proportional hazards survival analysis LBC1921 (N=436) and LBC1936 (N=906) blood samples none association between AAR and all-cause mortality (hazard ratio) R 'survival' library
Sensitivity Cox regression with white blood cell count covariates LBC1936 blood samples adjustment for measured cell counts (basophils, eosinophils, monocytes, lymphocytes, neutrophils) change in AAR-mortality test statistic before/after covariate adjustment R 'survival' library
Fisher exact test for enrichment of AAR-associated CpGs in cellular heterogeneity probes LBC1936 wave one blood samples none enrichment of AAR-associated CpGs among 72,393 cellular heterogeneity probes
DNA methylation age prediction in non-blood tissues 13 additional GEO cohorts, tissues other than blood none prediction accuracy (RMSE/correlation) compared to a multi-tissue predictor Illumina 450K/EPIC arrays
Beta-value transformation comparison for age prediction (BLUP) 8 cohorts with n>600 (LBC1921, LBC1936, GS, BSGS, SGPD, MND, GSE40279, GSE42861) power transformation (lambda 0.1-2), M value, arcsine sqrt, log transform of beta values prediction accuracy (RMSE) across transformations Illumina 450K arrays
Key results
  • Proportion of variance in age explained by DNA methylation was close to 1 (GS: 1, SE=0.0036; SGPD: 0.99, SE=0.058) proportion ~1
  • Permutation test (shuffled ages) showed no significant variance explained (GS: 0, SE=0.0030; SGPD: 0.0079, SE=0.013), confirming the near-1 estimate was not inflated
  • RMSE decreased and correlation increased as training sample size increased across both BLUP and Elastic Net predictors
  • Smallest RMSE achieved was 2.04 years (Elastic Net), lower than Hannum's and Horvath's predictors RMSE = 2.04 years
  • AAR from the best predictor showed no association with mortality in either LBC1921 (HR=1.08, 95% CI 0.91-1.27) or LBC1936 (HR=1.00, 95% CI 0.79-1.28) HR ~1.0-1.08
  • Overlap between the 514 probes in the new predictor and previously published predictors was small (30 in common with Hannum, 11 with Horvath) 30/514 and 11/514 overlap
Key statistics
  • other proportion explained = 1, SE = 0.0036 (REML variance explained in age by DNAm, GS cohort)
  • other proportion explained = 0.99, SE = 0.058 (REML variance explained in age by DNAm, SGPD cohort)
  • other proportion explained = 0, SE = 0.0030 (Permutation test null result, GS cohort)
  • other proportion explained = 0.0079, SE = 0.013 (Permutation test null result, SGPD cohort)
  • other RMSE = 2.04 years (Best Elastic Net predictor performance on test data)
  • other hazard ratio = 1.08, 95% CI 0.91-1.27 (AAR vs mortality, LBC1921 (386 deaths))
  • other hazard ratio = 1.00, 95% CI 0.79-1.28 (AAR vs mortality, LBC1936 (214 deaths))
  • count 514 probes selected (Elastic Net predictor probe count based on 13,566 training samples)

Statistical methods review

Model: opus

A neutral, descriptive read of the statistical approach — what was done, and (for shared learning, not as criticism) what could also have been done.

The study is a methodological/predictive-modelling analysis using 13,661 DNA methylation samples to build chronological-age predictors and probe the AAR–mortality relationship. The proportion of age variance explained by methylation was estimated with a mixed linear model via REML (OSCA), age predictors were trained with Elastic Net and BLUP across 65 training sets and evaluated by correlation and RMSE on held-out test sets, and the association between age acceleration residual (AAR) and mortality was tested with Cox proportional hazards regression. Results were reported as variance-explained estimates with standard errors, RMSE/correlation values, and hazard ratios with 95% confidence intervals.

Replicationmixed Sample sizeSample sizes per cohort tabulated; predictor training sizes ranged 335 to 12,710; no formal power calculation described GroupsDNA methylation vs chronological age; AAR vs mortality (deceased vs alive); predictors across training sizes/methods; blood vs non-blood tissues Pairingunclear Randomization/blindingnot stated Dispersionmixed Exact p-valuesno Effect sizesyes Confidence intervalsyes Multiplicity correctionBonferroni (P = 0.05/319,607)
Statistical tests used
Test Applied to n Assumptions
Restricted maximum likelihood (REML) mixed linear model (OSCA) proportion of variance of chronological age explained by all DNA methylation probes in GS and SGPD 2586 unrelated GS individuals; 1299 unrelated SGPD individuals stated
Permutation test (shuffled ages) validating the REML variance-explained estimates in GS and SGPD same GS and SGPD cohorts na
Cox proportional hazards regression association between AAR and mortality in LBC1921 and LBC1936 LBC1921 N=436 (386 deaths); LBC1936 N=906 (214 deaths) not stated
Fisher exact test enrichment of AAR-associated CpG sites among 72,393 cellular heterogeneity probes na
Elastic Net penalized regression (prediction model) building age predictors across 65 training sets; final 514-probe predictor training sample sizes 335 to 12,710 (final predictor 13,566) na
Best Linear Unbiased Prediction (BLUP) (prediction model) building age predictors and evaluating beta-value transformations training sample sizes 335 to 12,710 stated
Approaches that could also have been used
  • The AAR–mortality association was assessed with a Cox proportional hazards model with several technical covariates as fixed effects.
    Could also: A flexible parametric survival model (e.g., Royston-Parmar) or an accelerated failure time model could also be fitted, alongside an explicit check of the proportional-hazards assumption (e.g., scaled Schoenfeld residuals). — These would describe time-varying effects and provide a complementary view when the proportionality assumption is of interest, which is often informative in mortality follow-up data.
  • Predictor accuracy was summarized using correlation and RMSE on held-out test sets.
    Could also: Mean absolute error and a calibration/Bland-Altman-style analysis of predicted-minus-actual age could also be reported. — These add a view of systematic bias and age-dependent error patterns that complement a single RMSE or correlation value.
  • Enrichment of AAR-associated CpGs among cellular-heterogeneity probes was evaluated with a Fisher exact test.
    Could also: A logistic regression or permutation-based enrichment test that adjusts for probe-level covariates (e.g., methylation variability or genomic context) could also be used. — A model-based or permutation approach would let one account for probe characteristics and the known correlation structure among CpGs.
  • Cross-validation used five random cohort-level samples for each number of training cohorts (65 training sets).
    Could also: Repeated k-fold or nested cross-validation with more replicates, plus confidence intervals on the RMSE/correlation curves, could also be reported. — More resampling and uncertainty bands would quantify the variability of the sample-size-versus-accuracy relationship.
  • Cohort summaries reported mean age with SD, and REML estimates with SE.
    Could also: Reporting 95% confidence intervals alongside the SE for variance-explained estimates could also be done. — An interval presentation conveys the plausible range directly, which is often preferred when communicating an estimate that is bounded near 1.
  • Two outlier cohorts identified by PCA were retained because their prediction accuracy was not low.
    Could also: A sensitivity analysis re-running key models with those cohorts excluded could also be presented. — A leave-out sensitivity check would document how robust the main conclusions are to those specific cohorts.
Software: OSCA (REML variance estimation) · R, 'survival' package (Cox models) · DNAm-based-age-predictor (Elastic Net/BLUP, GitHub)

Result convergence & founder nodes

Findings this paper shares with others that ran a comparable experiment. A node’s strength is how many independent papers report it (replication breadth) — not how often it is cited, so a heavily-replicated but under-cited founder still stands out.

Citation network

Where this publication sits in the reproducibility-weighted citation graph — what it is built on, and what is built on it. Citation data from OpenAlex.

Citations
509
Impact: very high
Foundation confidence
None of its references are in our reproducibility record yet — its foundation cannot be assessed.
Topics

Assessed papers, coloured by verdict. Click a node to open it.

Built on (assessed references) (0)
  • No assessed neighbours yet — the network grows as more papers are assessed.
Cited by (assessed papers) (4)

Data lineage

The datasets this paper uses (text-mined from the full text via Europe PMC), and which other assessed papers stand on the same data. A shared dataset is a factual link — not a judgement.

GSE42861 GEO in Methods (http://purl.org/orb/Methods)
also used by 2 papers:
GSE40279 GEO in Methods (http://purl.org/orb/Methods)
also used by 1 paper:
GSE41169 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
GSE53740 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
GSE72773 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
GSE72775 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
GSE72777 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
GSE78874 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet

Downstream reach in the literature

99 downstream papers · 1 datasets

How widely the datasets deposited by this paper are reused across the whole literature (Europe PMC), beyond our assessed set. This is a factual dependency map — reusing a public dataset is normal, good science. It is not a judgement on the downstream papers; the only verdict here is this paper's own, with its cited rationale.

What was reproduced

The exact results taken into scope, with each reported value next to the value our attempt produced.

Figures / tables: Fig S4Fig 4Fig S3
C1
Reported
near-perfect age prediction (Elastic Net); predictor works (README self-test)
Reproduced
cor=0.9927, RMSE=5.396 yr, MAD=4.711 yr (N=10 shipped blood demo)
within tolerance
C2
Reported
BLUP near-perfect / comparable to EN
Reproduced
cor=0.9997, RMSE=0.855 yr, MAD=0.789 yr
within tolerance
C3
Reported
predictor comparable to / better than Horvath clock (Fig 4)
Reproduced
EN cor=0.9927 ~ Horvath 0.9953; BLUP cor=0.9997 > Horvath; RMSE BLUP 0.86 < Horvath 1.18 < EN 5.40
partial
C0
Reported
smallest RMSE (Elastic Net) = 2.04 years
Reproduced
NOT ATTEMPTED (large/restricted held-out cohorts, not shipped demo)
partial

Assessments & scoring basis

Each contributor’s verdict, the per-question basis, and the auditable, itemised worksheet behind it.

🤖 AI curator · claude (ai-curator room) · v1.0 L1 68/100

An automated assessment. It can flag an open question for review but can never, on its own, record a discrepancy verdict (C5) against a paper.

🟡1. Data identity
🟡2. Endpoint comparability
🟡3. Location of the main deviation
🟡4. Cause of the deviation
🟢5. Derivability / plausibility
🟡6. Severity of the deviation
🟢7. Core claim
🟡8. Severity of the miss (overall human judgment)
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Supporting (toward a concern)
Content-critical question only partially held
+2 pts
From: Q8 · Severity of the miss (overall human judgment) 🟡
Minor / cosmetic deviation
+1 pts
From: Q3 · Location of the main deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q4 · Cause of the deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q6 · Severity of the deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q2 · Endpoint comparability 🟡
Concordant (toward reproduced)
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Total score +4

The shipped, deterministic predictor (pred.R + EN/BLUP coef tables + 10-sample blood demo) reproduces 1:1, confirming the paper's central near-perfect age predictor claim (BLUP cor=0.9997, EN cor=0.9927); no fabrication flags and every examined value is derivable from shipped data+code. The only deviation — EN RMSE=5.4 yr on N=10 — sits on our side (a small-sample within-individual standardization effect of the 514-probe EN set), and is explained, not a paper contradiction. The exact headline numbers (RMSE=2.04 yr, Fig 1/4) rest on large, partly access-restricted LBC/GS/BSGS/tissue cohorts and were intentionally not attempted (data availability, 80/20 scope), so the quantitative headline is unverified rather than refuted.

🤝
Reproduced automatically — and fairly

Automated reproduction checks whether a published result can be regenerated from the paper’s described methods and shared data. When something does not reproduce, that is not a claim of error or misconduct — most often it reflects under-described methods, software or environment differences, or gaps in data access, and some of the pre-print papers in the queue may carry issues their authors had no part in. The goal is shared awareness that rigorous, fully-described methods help everyone — never a judgement of any author.

Are you an author? We would genuinely like to hear from you — to clarify the record, add data or code, re-run the pipeline after an accession update, and publish your response right next to the assessment. Everything here is open and auditable.

🚩 Report an error in this record

Spotted something wrong — a verdict you’d contest, a data or value error, or a private detail that slipped through? Tell us, with a short justification. Authors and readers are equally welcome to write in; we review every report.

Prefer email, or the form below not working? Contact us at [email protected].

Reproduction footprint

claude-opus-4-8

Measured resources invested to assess this paper — sanitised (machine class only, no job ids/paths). Compute = HPC accounting (SLURM); tokens = the AI agent's session.

117.9 k
tokens (I/O) · 7 M incl. cache
12 min
runtime · 0 CPU-h
0.7 GB
peak RAM
1 (1 failed)
HPC jobs
hummel
machine