Corpus 1,272 assessed · 1,173 scored · 643 reproduced ≥75 · 168 flagged ·∅ 74.1/100
← New search

Genomic analysis of bacteria in the Acute Oak Decline pathobiome.

Microb Genom · 2019
L1 100/100 3/4
Why this verdict

The main results reproduced: recomputed values matched the published ones within tolerance.

Reproduced on the brainbox compute brainarbeit.com
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Concordant (toward reproduced)
All content-critical questions reproduced
-4 pts
From: Q7 · Core claim 🟢
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Every question reproduced
-1 pts
From: “every question reproduced”
Total score -7
✓ What held up
  • Same input data as the authors
  • Reported values were directly comparable
  • No relevant deviation in data/preprocessing
  • No authors-side cause for any deviation
  • Reported values are derivable from the shared data
  • Any deviation was negligible
  • The central claim held under reproduction
  • Overall, the reproduction was clean
What did not (or only partly)
  • Every checked point held up.
How its reproducibility compares
100/100
Reproducibility score
1.5 SD above mean
vs. all fields · 1173 studies
🎯 Scores higher than 95% of all assessed papers rank 1 of 1173 scored

A 0–100 reproducibility-quality score from the per-question grades, shown as a z-score: standard deviations above (+) or below (−) the mean of comparable assessments.

Reproduction agent’s raw note

salvaged by watchdog from agreement.json (agent omitted ROOM_RESULT.json)

These records describe the outcome of reproduction attempts carried out autonomously by brainbox using large language models (LLMs). They are not peer review, not an audit, and not a determination of error or misconduct by any author. A verdict reflects what one attempt could or could not reproduce — which may depend on data access, undocumented parameters, the computing environment, or the depth of effort — and not a judgement of the people who did the work. We can be wrong, and we correct mistakes quickly: every record carries a “report an error” button.

✎ I am an author of this paper

Updated or fixed a deposit, or is there an erratum? Ask us to re-run the metrics. We verify by email first; the new result is published as a new version with full history — nothing is overwritten.

Reason for the rerun

We email you a confirmation link first. The rerun is an objective re-measurement — it cannot change the verdict in your favour, only ask us to look again.

Provenance — full disclosure

When this reproduction was carried out, which methodology version was used, and by whom — so the record can be audited and checked independently.

Reproduced
2026-06-19
Rubric version
v1.0
Assessed by
🤖 AI curator · claude (ai-curator room) · v1.0 · run #1 2026-06-16
no human curator yet
Last updated
2026-07-29

Provisional, curator- or AI-assessed, and independently checkable. A reproduction outcome states what one attempt could reproduce — not a judgement of the authors.

Deep full-text extraction

Model: opus
Founding hypothesis

Can comparative whole-genome analysis of bacteria isolated from Acute Oak Decline (AOD) lesions reveal genome-encoded virulence mechanisms that distinguish primary phytopathogens from secondary/accessory contributors within the AOD lesion pathobiome?

Core claims
  • All studied members of the AOD lesion microbiota possess virulence genes associated with phytopathogens finding
  • Brenneria goodwinii has the genome most characteristic of a necrogenic phytopathogen, corroborating its role as the key causal agent of AOD lesions finding
  • B. goodwinii and Lonsdalea britannica are potential primary pathogens in a predisposed tree, whereas Gibbsiella quercinecans and others may act as secondary/opportunistic or accessory contributors mechanism
  • G. quercinecans may contribute to tissue necrosis through release of necrotizing enzymes and help more dangerous pathogens realize their pathogenic potential mechanism
  • Orthologous gene inference can identify shared virulence genes that retain the same function across pathobiome members and reference phytopathogens method
  • AOD is caused by an interactive bacterial pathobiome, supporting the concept of tree diseases caused by polymicrobial complexes finding
  • Whole genome sequencing combined with ecological data provides insights into pathogenic potential of bacterial species method
Experimental setups
Assay System Perturbation Readout Platform
Whole genome sequencing (WGS) Gibbsiella quercinecans strains FRB97, FRB124, N78; Brenneria goodwinii strains FRB141, FRB171 (bacterial isolates from AOD-affected oak) none genome assembly, contigs, gene count, GC content Illumina MiSeq Personal Sequencer; Nextera XT library prep
Whole genome sequencing (WGS) Lonsdalea britannica 477 and Rahnella variigena CIP105588T none complete genome assembly and motif summary Pacific Biosciences RSII (SMRT, P6/C4 chemistry)
Whole genome sequencing (WGS) Brenneria alni NCPPB 3934 and Brenneria salicis DSM 30166 (reference phytopathogens) none genome assembly metrics Illumina MiSeq; Nextera XT
De novo genome assembly MiSeq reads of G. quercinecans and B. goodwinii strains none contig number and sequencing coverage SPAdes v3.0 (k-mers 21–231)
Comparative genomics / orthologous gene inference AOD pathobiome genomes vs canonical phytopathogens and non-pathogenic symbionts none degree of orthology and degree of virulence orthology
Functional annotation of virulence genes AOD lesion microbiota genomes none presence of phytopathogen-associated virulence genes (PCWDEs, T3SS, effectors)
Post-sequencing quality control / read trimming MiSeq FastQ reads none adapter-trimmed, quality-trimmed reads Cutadapt v1.2.1; Sickle v1.2 (Q20)
Key results
  • B. goodwinii FRB141 (Pectobacteriaceae) genome had degree of virulence orthology of 20, matching reference necrogenic phytopathogens virulence orthology = 20
  • G. quercinecans strains showed lower degree of virulence orthology (16) than B. goodwinii and L. britannica (20) 16 vs 20
  • L. britannica 477 genome had degree of virulence orthology of 20, consistent with primary pathogen potential virulence orthology = 20
  • G. quercinecans FRB124 assembled into 90 contigs at 92x coverage 90 contigs, 92x
  • G. quercinecans N78 assembled into 129 contigs at 75x coverage 129 contigs, 75x
  • B. goodwinii FRB171 assembled into 128 contigs at 52x coverage 128 contigs, 52x
  • All AOD pathobiome members possessed genes associated with phytopathogens
Key statistics
  • other GC content 51 mol% (B. goodwinii FRB141) (chromosome G+C content, 5 281 917 bp genome)
  • count 4625 genes (85.8% gene density) (B. goodwinii FRB141 chromosomal gene count)
  • count 5125 genes (86.9% gene density) (G. quercinecans FRB97, 5 548 506 bp, 56 mol% GC)
  • count 3801 genes (87.2%) (L. britannica 477, 4 015 589 bp, 55 mol% GC)
  • other degree of virulence orthology = 20 (B. goodwinii, L. britannica, R. variigena, several reference phytopathogens)
  • other degree of virulence orthology = 16 (G. quercinecans strains FRB97 and FRB124)
  • count 5202 genes (86.4%) (G. quercinecans N78, 5 693 731 bp, 56 mol% GC)
  • other sequencing coverage 52x–92x (MiSeq de novo assemblies of AOD strains)

Statistical methods review

Model: opus

A neutral, descriptive read of the statistical approach — what was done, and (for shared learning, not as criticism) what could also have been done.

The study uses a comparative genomics design rather than a hypothesis-testing statistical framework: whole genomes of AOD lesion-associated bacteria were sequenced (Illumina MiSeq and PacBio RSII), assembled de novo, annotated, and compared against reference phytopathogen and non-pathogen genomes. Pathogenic potential was assessed descriptively through orthologous gene inference and sequence-similarity searches for shared virulence-gene homologues, summarised as counts such as 'degree of orthology' and 'degree of virulence orthology' per genome. Results are reported as genome metrics and gene/ortholog counts in tables; no inferential statistical tests, p-values, or dispersion measures are described in the available text.

Replicationunclear Sample sizeSample size is described as the number of individual bacterial genomes sequenced or downloaded (e.g., two G. quercinecans strains, B. goodwinii strains, and reference genomes), not as a statistically powered sample; no power analysis is stated GroupsAOD lesion isolates vs. reference canonical phytopathogens and non-pathogenic symbionts (genome-level comparison) Pairingna Randomization/blindingna Dispersionnone Confidence intervalsno Multiplicity correctionnone stated
Approaches that could also have been used
  • Pathogenic potential and shared virulence content were assessed by counting orthologous and virulence-orthologous genes per genome (descriptive comparison across genomes).
    Could also: A statistical enrichment test (e.g., Fisher's exact test or a hypergeometric/over-representation test) comparing virulence-gene categories between lesion isolates and reference groups could also be reported. — Such tests would attach a quantified measure of how unexpected an observed count is relative to a background, complementing the descriptive counts.
  • Genomes were grouped and discussed by family and pathogen/symbiont status using ortholog counts.
    Could also: A clustering or ordination approach (e.g., hierarchical clustering, PCA, or a presence/absence gene-content distance with a phylogenomic tree) could also be used to summarise relationships among genomes. — This would provide a multivariate, reproducible visualisation of how genomes group by gene content and could indicate the relative similarity among isolates and references.
  • Comparisons are presented as point counts (e.g., degree of orthology) for single representative genomes per organism.
    Could also: Where multiple strains per species are available, summarising within-species variation with a range, IQR, or confidence interval could also be reported. — Conveying spread alongside point estimates helps readers gauge how representative a single value is, which is often informative for small numbers of strains.
  • Ortholog inference relied on sequence-similarity searches with thresholds described via the linked command set.
    Could also: Reporting the statistical parameters of the homology search (e.g., E-value cutoffs, percent identity/coverage thresholds) explicitly in the text, and/or a sensitivity analysis across thresholds, could also accompany the counts. — Stating thresholds and their sensitivity makes the basis of each ortholog call transparent and shows how robust the counts are to parameter choice.
Software: Cutadapt 1.2.1 · Sickle 1.2 · SPAdes 3.0

Result convergence & founder nodes

Findings this paper shares with others that ran a comparable experiment. A node’s strength is how many independent papers report it (replication breadth) — not how often it is cited, so a heavily-replicated but under-cited founder still stands out.

Citation network

Where this publication sits in the reproducibility-weighted citation graph — what it is built on, and what is built on it. Citation data from OpenAlex.

Citations
63
Impact: high
Foundation confidence
None of its references are in our reproducibility record yet — its foundation cannot be assessed.
Topics

No assessed neighbours yet — the network grows as more papers are assessed.

Data lineage

The datasets this paper uses (text-mined from the full text via Europe PMC), and which other assessed papers stand on the same data. A shared dataset is a factual link — not a judgement.

CP007045 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP009885 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP011246 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP011930 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP012145 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP012914 ENA in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
CP014136 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
CP014137 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
CP023009 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
MAEN01000001 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
NC_003295 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_006270 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_007005 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_007705 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_008380 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_011365 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_012917 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_013961 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_014306 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_014500 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
NC_020800 RefSeq in Article (http://semanticscience.org/resource/SIO_001029)
no other assessed paper uses this yet
PRJNA342025 BioProject in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SAMN05732390 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN05732392 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN05732394 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN05732419 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN05733147 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN07554530 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SAMN07554573 BioSamples in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SRX2141032 ENA in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SRX3131452 ENA in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet
SRX3145876 ENA in Conclusion (http://purl.obolibrary.org/obo/IAO_0000615)
no other assessed paper uses this yet

What was reproduced

The exact results taken into scope, with each reported value next to the value our attempt produced.

Figures / tables: TableFig 1aFig 1cFig 1
C-DEG-WG-FRB97
Reported
21
Reproduced
21
exact
C-DEG-WG-FRB124
Reported
23
Reproduced
23
exact
C-DEG-WG-N78
Reported
2
Reproduced
2
exact
C-DEG-WG-FRB141
Reported
20
Reproduced
20
exact
C-DEG-WG-FRB171
Reported
18
Reproduced
18
exact
C-DEG-WG-Lqb
Reported
15
Reproduced
15
exact
C-DEG-WG-RVAR
Reported
21
Reproduced
21
exact
C-DEG-WG-RVIC
Reported
23
Reproduced
23
exact
C-DEG-VF-FRB97
Reported
16
Reproduced
16
exact
C-DEG-VF-FRB124
Reported
16
Reproduced
16
exact
C-DEG-VF-N78
Reported
Reproduced
exact
C-DEG-VF-FRB141
Reported
20
Reproduced
20
exact
C-DEG-VF-FRB171
Reported
20
Reproduced
20
exact
C-DEG-VF-Lqb
Reported
20
Reproduced
20
exact
C-DEG-VF-RVAR
Reported
20
Reproduced
20
exact
C-DEG-VF-RVIC
Reported
20
Reproduced
20
exact
C-COMP-WG
Reported
major comp 27; isolated B.licheniformis,X.fastidiosa
Reproduced
27; [BL,XF]
exact
C-COMP-VF
Reported
major comp 26; 3 isolated incl N78,M.mesophilicum
Reproduced
26; [BL,N78,MM]
exact
C-SHIFT-N78
Reported
2->0
Reproduced
2->0
exact
C-SHIFT-MM
Reported
7->0
Reproduced
7->0
exact
C-SHIFT-RLT
Reported
7->2
Reproduced
7->2
exact
C-SHIFT-RLV
Reported
11->2
Reproduced
11->2
exact
C-SHIFT-RS
Reported
3->1
Reproduced
3->1
exact
C-SHIFT-PS
Reported
25->23
Reproduced
25->23
exact
C-NET-NODES
Reported
29
Reproduced
29
exact
C-CHI-OVERALL
Reported
P=8.47e-11
Reproduced
P=8.468e-11 (X2=104.76,df=28)
exact
C-ASM-FRB97-size
Reported
5548506
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-FRB97-gc
Reported
56
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-FRB97-genes
Reported
5125
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Lqb-size
Reported
4015589
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Lqb-gc
Reported
55
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Lqb-genes
Reported
3801
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Rvar-size
Reported
5499108
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Rvar-gc
Reported
52
Reproduced
PENDING
m.public.grade.uncheckable
C-ASM-Rvar-genes
Reported
5187
Reproduced
PENDING
m.public.grade.uncheckable

Assessments & scoring basis

Each contributor’s verdict, the per-question basis, and the auditable, itemised worksheet behind it.

🤖 AI curator · claude (ai-curator room) · v1.0 L1 100/100

An automated assessment. It can flag an open question for review but can never, on its own, record a discrepancy verdict (C5) against a paper.

🟢1. Data identity
🟢2. Endpoint comparability
🟢3. Location of the main deviation
🟢4. Cause of the deviation
🟢5. Derivability / plausibility
🟢6. Severity of the deviation
🟢7. Core claim
🟢8. Severity of the miss (overall human judgment)
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Concordant (toward reproduced)
All content-critical questions reproduced
-4 pts
From: Q7 · Core claim 🟢
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Every question reproduced
-1 pts
From: “every question reproduced”
Total score -7

All 26 deterministic-core claims reproduced 1:1 from the authors' shipped intermediates (graphml + Yes_no_data.csv) using a faithful port of their own R notebook — Table 1 degrees, component sizes (27/26), the six WG→virulence degree shifts, and the chi-squared (reported P=8.47e-11 vs reproduced 8.468e-11, only rounding). Data identity is strong because the exact analysis intermediates are deposited. The sole gap is the 9 upstream assembly metrics, which stayed PENDING (re-assembly not completed) — that is unverified coverage on our side, not a discrepancy or an authors' defect. Central conclusion holds fully; overall a clean, well-supported reproduction.

🤝
Reproduced automatically — and fairly

Automated reproduction checks whether a published result can be regenerated from the paper’s described methods and shared data. When something does not reproduce, that is not a claim of error or misconduct — most often it reflects under-described methods, software or environment differences, or gaps in data access, and some of the pre-print papers in the queue may carry issues their authors had no part in. The goal is shared awareness that rigorous, fully-described methods help everyone — never a judgement of any author.

Are you an author? We would genuinely like to hear from you — to clarify the record, add data or code, re-run the pipeline after an accession update, and publish your response right next to the assessment. Everything here is open and auditable.

🚩 Report an error in this record

Spotted something wrong — a verdict you’d contest, a data or value error, or a private detail that slipped through? Tell us, with a short justification. Authors and readers are equally welcome to write in; we review every report.

Prefer email, or the form below not working? Contact us at support@doesitreproduce.com.

Reproduction footprint

<synthetic>

Measured resources invested to assess this paper — sanitised (machine class only, no job ids/paths). Compute = HPC accounting (SLURM); tokens = the AI agent's session.

173 k
tokens (I/O) · 17.7 M incl. cache
92 min
runtime
Per-job HPC accounting not captured for this run — the runtime shown is the reproduction’s measured wall-clock time.