Corpus 1,286 assessed · 1,187 scored · 648 reproduced ≥75 · 174 flagged ·∅ 73.9/100
← New search

Genome of the Asian longhorned beetle (Anoplophora glabripennis), a globally significant invasive species, reveals key functional and evolutionary innovations a

Genome Biol · 2016
L1 84/100 3/4
Why this verdict

The main results reproduced: recomputed values matched the published ones within tolerance.

Reproduced on the brainbox compute brainarbeit.com
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Concordant (toward reproduced)
All content-critical questions reproduced
-4 pts
From: Q7 · Core claim 🟢
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Every question reproduced
-1 pts
From: “every question reproduced”
Total score -7
✓ What held up
  • Same input data as the authors
  • Reported values were directly comparable
  • No relevant deviation in data/preprocessing
  • No authors-side cause for any deviation
  • Reported values are derivable from the shared data
  • Any deviation was negligible
  • The central claim held under reproduction
  • Overall, the reproduction was clean
What did not (or only partly)
  • Every checked point held up.
How its reproducibility compares
84/100
Reproducibility score
0.6 SD above mean
vs. all fields · 1187 studies
🎯 Scores higher than 64% of all assessed papers rank 393 of 1187 scored

A 0–100 reproducibility-quality score from the per-question grades, shown as a z-score: standard deviations above (+) or below (−) the mean of comparable assessments.

Reproduction agent’s raw note

Described well enough; 1:1 reproduction of the clearly-specified pipeline-derived summary statistics from the paper's OWN deposited data using standard third-party tools (P16). Assembly GCA_000390285.1 (Agla_1.0) recomputed with seqkit v2.13.0, assembly-stats v1.0.1, and an independent python script (all agree): total 707,712,193 bp (paper '710 Mb', within-tol 0.32%), scaffold N50 658,851 bp ('659 kb', exact), contig N50 16,544 bp ('16.5 kb', exact); cross-checked against NCBI's own assembly_stats. Official Gene Set v1.2 (i5k NAL) recounted two independent ways: 22,253 protein-coding genes (paper 22,253, EXACT) and 66 pseudogenes (paper 66, EXACT). Four claims exact, two within-tol, zero mismatch, no fabrication flags. NOT attempted (hard-20% / non-deposited): MAKER pre-curation count 22,035 (intermediate not deposited), BUSCO completeness (version-locked benchmark set, cannot match 1:1), and all wet-lab + de-novo-assembly + orthology/phylogenomics analyses (out of scope, see scope.md). The de-novo assembly and MAKER annotation themselves were not re-run; their deposited outputs were measured instead.

💻 Code ↗ 🗄 Data: GSE68149

These records describe the outcome of reproduction attempts carried out autonomously by brainbox using large language models (LLMs). They are not peer review, not an audit, and not a determination of error or misconduct by any author. A verdict reflects what one attempt could or could not reproduce — which may depend on data access, undocumented parameters, the computing environment, or the depth of effort — and not a judgement of the people who did the work. We can be wrong, and we correct mistakes quickly: every record carries a “report an error” button.

Assessment versions

Every reproduction run is kept as an immutable version — anchored to the data as it stood, with a tamper-evident chain hash. A rerun (e.g. after an author updates a deposit) adds a new version; the previous one stays on record.

  1. v1 current initial assessment Score 84
    assessed: 2026-06-16 ⛓ c34fbdb1c7f0
✎ I am an author of this paper

Updated or fixed a deposit, or is there an erratum? Ask us to re-run the metrics. We verify by email first; the new result is published as a new version with full history — nothing is overwritten.

Reason for the rerun

We email you a confirmation link first. The rerun is an objective re-measurement — it cannot change the verdict in your favour, only ask us to look again.

Provenance — full disclosure

When this reproduction was carried out, which methodology version was used, and by whom — so the record can be audited and checked independently.

Reproduced
2026-06-16
Rubric version
v1.0
Assessed by
🤖 AI curator · claude (ai-curator room) · v1.0 · run #1 2026-06-16
no human curator yet
Last updated
2026-07-31

Provisional, curator- or AI-assessed, and independently checkable. A reproduction outcome states what one attempt could reproduce — not a judgement of the authors.

Deep full-text extraction

Model: sonnet
Founding hypothesis

The genomic basis of specialized wood-feeding (xylophagy) and broad phytophagy in the Asian longhorned beetle (Anoplophora glabripennis) can be explained by an expanded and diversified arsenal of plant cell wall degrading enzymes, detoxification genes, and chemosensory genes, some acquired via horizontal gene transfer.

Core claims
  • The A. glabripennis genome encodes a uniquely diverse arsenal of enzymes that degrade plant cell wall polysaccharide networks (cellulose, hemicellulose, pectin) and detoxify plant allelochemicals. finding
  • Some plant cell wall degrading enzyme (PCWDE) gene families were originally acquired via horizontal gene transfer (HGT) from fungi or bacteria and subsequently diversified into multi-gene families. mechanism
  • Large expansions of chemosensory genes involved in pheromone and plant kairomone reception are consistent with the beetle's use of complex chemical cues to find host plants and mates. finding
  • A high-quality draft genome assembly and official gene set (OGS v1.2) were produced for A. glabripennis using a customized MAKER annotation pipeline. resource
  • A. glabripennis possesses an incomplete DNA methylation machinery, retaining maintenance methyltransferase DNMT1 but lacking de novo methyltransferase DNMT3. finding
  • Eight bacterial HGT candidates were identified in the A. glabripennis genome, mostly related to Wolbachia, with varying inferred insertion ages. finding
  • A. glabripennis is phylogenetically sister to Dendroctonus ponderosae (mountain pine beetle) among the beetle genomes analyzed. finding
  • A. glabripennis has the most Coleoptera-specific genes among five studied beetle genomes, suggesting a high degree of adaptive novelty. finding
Experimental setups
Assay System Perturbation Readout Platform
Whole-genome sequencing and assembly single female A. glabripennis larva none genome assembly size, contig/scaffold N50
Gene annotation (customized MAKER pipeline plus manual curation) A. glabripennis genome none number and structure of gene models MAKER pipeline
BUSCO completeness assessment A. glabripennis genome and OGS, compared with 14 other insect genomes none percentage of missing/complete benchmarking universal single-copy orthologs BUSCO (2675 arthropod orthologs)
Orthology delineation (comparative genomics) A. glabripennis and 14 other insect genomes none counts of conserved, widespread, and lineage-restricted orthologous groups OrthoDB
DNA-based horizontal gene transfer (HGT) detection pipeline A. glabripennis genome none candidate bacterial HGT insertions and sequence similarity to bacterial sources DNA-based HGT pipeline
Phylogenomic analysis (maximum likelihood tree) amino acid sequences from 523 orthologs across 15 insect species none phylogenetic relationships and divergence time estimates
RNA-seq expression profiling A. glabripennis adult males, adult females, and larvae (whole organism) none expression of candidate HGT genes
Key results
  • Draft genome assembly of 710 Mb generated from 134x sequence coverage, with contig N50 of 16.5 kb and scaffold N50 of 659 kb 710 Mb assembly; 134x coverage
  • 22,035 gene models annotated automatically, 1144 manually curated, merged into a non-redundant OGS v1.2 with 22,253 protein-coding gene models and 66 pseudogenes 22,253 genes vs. 13,526-19,222 in other beetle genomes
  • A. glabripennis OGS had fewer missing BUSCOs than most other genomes studied ~3.3% missing BUSCOs
  • A conserved core of 5029 A. glabripennis genes classified in orthologous groups shared with all 14 other insect genomes; 6880 widespread orthologs identified, about half single-copy and half duplicated 5029 conserved orthologs; 3346 single-copy; 3534 duplicated
  • A. glabripennis has the most Coleoptera-specific genes (5229) among the five beetle genomes studied, with 1003 genes showing no homology to other arthropod genes 5229 Coleoptera-specific genes; 1003 unique genes
  • Eight bacterial HGT candidates identified, four related to Wolbachia; two showed 95% sequence similarity (recent insertion) and two showed 70-71% similarity with indels (older, degrading insertions) 95% vs 70-71% sequence similarity
  • None of the bacterial HGT candidates showed significant expression in RNA-seq reads from adult males, females, or larvae
  • Phylogenomic analysis placed A. glabripennis sister to Dendroctonus ponderosae with 100% ML bootstrap support at all nodes 100% bootstrap support
Key statistics
  • count 710 Mb draft assembly (genome assembly size at 134x coverage)
  • other contig N50 16.5 kb, scaffold N50 659 kb (assembly contiguity metrics)
  • mean female 981.42 ± 3.52 Mb, male 970.64 ± 3.69 Mb (flow cytometry-estimated genome size)
  • count 22,253 protein-coding gene models and 66 pseudogenes (official gene set OGS v1.2)
  • other ~3.3% missing BUSCOs (genome/OGS completeness assessment)
  • count 5029 conserved orthologous genes (orthologs shared across all 15 insect genomes studied)
  • other $889 billion (estimated potential economic impact in the US if uncontrolled (inflation-adjusted, May 2016))
  • other 95% and 70-71% sequence similarity (similarity of bacterial HGT candidates to Wolbachia and other bacterial sources)

Statistical methods review

Model: opus

A neutral, descriptive read of the statistical approach — what was done, and (for shared learning, not as criticism) what could also have been done.

This is primarily a genome sequencing, annotation, and comparative genomics study rather than a hypothesis-testing experimental paper. The reported approach centers on genome assembly metrics (coverage, contig/scaffold N50), gene-model annotation (MAKER pipeline plus manual curation), completeness assessment with BUSCO, orthology delineation (OrthoDB), maximum-likelihood phylogenomics with bootstrap support, and HGT detection; genome-size estimates are reported as a mean with a dispersion value. No conventional inferential statistical tests (e.g., t-tests, ANOVA) for group comparisons are described in the provided text.

Replicationunclear Sample sizeGenome assembled from a single female larva; comparative analyses used the A. glabripennis genome plus 14 additional insect genomes (15 total); no power/sample-size calculation described GroupsA. glabripennis vs 14 other insect genomes (comparative genomics) Pairingna Randomization/blindingna Dispersionunclear Confidence intervalsno Multiplicity correctionnone stated
Statistical tests used
Test Applied to n Assumptions
Maximum likelihood phylogenetic inference with bootstrap support Fig. 2a ML tree from amino acid sequences of 523 orthologs (all nodes 100 % ML bootstrap support) 523 orthologs not stated
Approaches that could also have been used
  • Genome-size estimates are reported as a mean followed by a single ± dispersion value (e.g., 981.42 ± 3.52 Mb) without specifying whether it is SD or SEM.
    Could also: Explicitly labeling the dispersion as SD, SEM, or reporting a 95 % confidence interval, and stating the number of measurements. — Naming the dispersion statistic and n makes the spread unambiguous and lets readers gauge measurement precision; SD or a CI is often preferred for conveying variability.
  • Node support on the maximum-likelihood phylogeny is summarized with bootstrap percentages.
    Could also: Complementary support assessment such as Bayesian posterior probabilities, approximate likelihood-ratio tests (aLRT/SH-aLRT), or ultrafast bootstrap. — Multiple, methodologically distinct support measures can corroborate one another and provide additional perspective on branch reliability.
  • Gene-family and ortholog counts are compared descriptively across the 15 genomes.
    Could also: Model-based gene-family expansion/contraction analyses (e.g., CAFE) or phylogenetically informed comparative methods. — Such approaches place count differences in an explicit evolutionary and statistical framework, accounting for shared ancestry when interpreting lineage-specific expansions.
  • Genome completeness is assessed using BUSCO ortholog presence/absence proportions.
    Could also: Reporting these proportions with binomial confidence intervals, alongside complementary metrics such as read-mapping rates or k-mer-based completeness. — Adding interval estimates and orthogonal metrics conveys the uncertainty around completeness percentages and cross-validates the assessment.
Software: MAKER (genome annotation pipeline) · BUSCO (completeness assessment) · OrthoDB (orthology delineation)

Result convergence & founder nodes

Findings this paper shares with others that ran a comparable experiment. A node’s strength is how many independent papers report it (replication breadth) — not how often it is cited, so a heavily-replicated but under-cited founder still stands out.

Citation network

Where this publication sits in the reproducibility-weighted citation graph — what it is built on, and what is built on it. Citation data from OpenAlex.

Citations
300
Impact: very high
Foundation confidence
None of its references are in our reproducibility record yet — its foundation cannot be assessed.
Topics

Assessed papers, coloured by verdict. Click a node to open it.

Built on (assessed references) (0)
  • No assessed neighbours yet — the network grows as more papers are assessed.
Cited by (assessed papers) (2)

Data lineage

The datasets this paper uses (text-mined from the full text via Europe PMC), and which other assessed papers stand on the same data. A shared dataset is a factual link — not a judgement.

GCA_000390285.1 GCA in Methods (http://purl.org/orb/Methods)
also used by 1 paper:
GSE68149 GEO in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
IPR000334 InterPro in Results (http://purl.org/orb/Results)
no other assessed paper uses this yet
IPR000743 InterPro in Results (http://purl.org/orb/Results)
no other assessed paper uses this yet
IPR001031 InterPro in Results (http://purl.org/orb/Results)
no other assessed paper uses this yet
IPR001360 InterPro in Results (http://purl.org/orb/Results)
no other assessed paper uses this yet
IPR001547 InterPro in Results (http://purl.org/orb/Results)
no other assessed paper uses this yet
PRJNA163973 BioProject in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
PRJNA279780 BioProject in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX326764 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX326765 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX326766 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX326767 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX326768 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX873912 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet
SRX873913 ENA in Methods (http://purl.org/orb/Methods)
no other assessed paper uses this yet

What was reproduced

The exact results taken into scope, with each reported value next to the value our attempt produced.

Scope — pmid-27832824 (Asian longhorned beetle genome, McKenna et al., Genome Biol 2016)

Paper: doi:10.1186/s13059-016-1088-8 · PMCID PMC5105290 Code (supp scripts): https://github.com/NAL-i5K/AGLA_GB_supp-scripts @ f93a3dc (master, 2018-03-20) Data:

  • Genome assembly: GenBank GCA_000390285.1 (Agla_1.0) — exact accession cited in paper.
  • OGS v1.2 (official gene set): i5k NAL BCM-After-Atlas/.../OGS_v1_2/agla_OGS_v1_2.gff3.gz (the paper's own gene set; NAL "Current" has moved to v1.3.1 — we deliberately use v1.2).
  • Expression: GEO GSE68149 (RNA-seq, used for annotation) — not reproduced (see out-of-scope).

In scope (pipeline-derived, clearly specified, deterministic)

These are summary statistics computed by standard pipelines over deposited data. We reproduce them by running standard third-party tools on the paper's own deposited data (brief rule P16: third-party tool on the paper's data is equally valid).

id reported (paper) location how reproduced
asm_total draft assembly "710 Mb" Results, ¶ "draft genome reference assembly of 710 Mb" total bp of GCA_000390285.1 FASTA (seqkit/assembly-stats + own python)
asm_scaf_n50 scaffold N50 = 659 kb same ¶ (Add. file1 Table S3) scaffold N50 over FASTA records
asm_contig_n50 contig N50 = 16.5 kb same ¶ contig N50 (scaffolds split on N-gaps)
ogs_genes OGS v1.2 = 22,253 protein-coding gene models Results ¶ "official gene set (OGS v1.2)" count gene features in agla_OGS_v1_2.gff3
ogs_pseudo 66 pseudogenes same ¶ count pseudogene features in OGS v1.2 GFF3
maker_models 22,035 gene models (MAKER, pre-curation) Results ¶ "Using a customized MAKER pipeline, 22,035 gene models" NOT directly reproduced — MAKER intermediate not deposited; cross-check only

Cross-check (not a paper-tool reproduction, but confirms the deposited data is the paper's): NCBI's own assembly_stats.txt for GCA_000390285.1 reports total-length 707,712,193; scaffold-N50 658,851; contig-N50 16,551; gc 32.5% — i.e. "710 Mb", "659 kb", "16.5 kb" rounded. We independently recompute from the FASTA to confirm.

Optional / hard last-20% (attempt lightly or skip with reason)

  • BUSCO completeness (paper: arthropod set of 2675 BUSCOs; A. glabripennis gene set ~3.3% missing, Fig.2). BUSCO is version-sensitive (paper used BUSCO v1 / early arthropoda set, 2675 BUSCOs; modern BUSCO uses OrthoDB v10 with a different, larger arthropoda_odb10 set of ~1013/5235 BUSCOs). A modern rerun cannot match "2675" or "3.3%" 1:1 — it is a different benchmark set. Recorded as a known version-drift limitation; not run as a 1:1 claim.

Out of scope (not pipeline-reproducible from deposited data)

  • Wet-lab: flow-cytometry genome size (981 Mb female / 970 Mb male), in-vitro enzyme assays, manual curation of 1144 gene models.
  • De-novo genome assembly itself (ALLPATHS-LG + Atlas-Link/Atlas-gapfill over raw SRA reads): the assembly output is deposited and we reproduce stats over it, but re-running ALLPATHS-LG at 222× coverage is heavy, non-deterministic, and out of the 80/20 budget. Not attempted.
  • MAKER re-annotation (would require the full repeat library, training, RNA-seq evidence; the OGS output is deposited and we count it instead).
  • Gene-family expansions / OrthoDB orthology / HGT / phylogenomics: depend on the 87-species OrthoDB v8 build + the supp perl scripts with hardcoded inputs; the authors' numbers are not regenerable from the shipped scripts alone. Not attempted.
Figures / tables: 1 TableTableFig.2
asm_total
Reported
710 Mb
Reproduced
707,712,193 bp (707.7 Mb)
within tolerance
asm_scaf_n50
Reported
659 kb
Reproduced
658,851 bp
exact
asm_contig_n50
Reported
16.5 kb
Reproduced
16,544 bp
exact
ogs_genes
Reported
22,253
Reproduced
22,253
exact
ogs_pseudo
Reported
66
Reproduced
66
exact
asm_gc
Reported
32.5% (NCBI cross-check; paper omits)
Reproduced
32.74% over ACGT
within tolerance
maker_models
Reported
22,035
Reproduced
partial
busco
Reported
2675-set, ~3.3% missing
Reproduced
partial

Assessments & scoring basis

Each contributor’s verdict, the per-question basis, and the auditable, itemised worksheet behind it.

🤖 AI curator · claude (ai-curator room) · v1.0 L1 84/100

An automated assessment. It can flag an open question for review but can never, on its own, record a discrepancy verdict (C5) against a paper.

🟢1. Data identity
🟢2. Endpoint comparability
🟢3. Location of the main deviation
🟢4. Cause of the deviation
🟢5. Derivability / plausibility
🟢6. Severity of the deviation
🟢7. Core claim
🟢8. Severity of the miss (overall human judgment)
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Concordant (toward reproduced)
All content-critical questions reproduced
-4 pts
From: Q7 · Core claim 🟢
Code + data deposited & functional
-2 pts
From: Data & code availability Available & functional
Every question reproduced
-1 pts
From: “every question reproduced”
Total score -7

This is a clean, high-quality reproduction: every in-scope summary statistic was recomputed from the authors' own exactly-cited deposited data (GCA_000390285.1 assembly + OGS v1.2 GFF3) using multiple independent tools that all agree, with four exact and two within-rounding matches and zero mismatches. The only deviation — 707.7 Mb vs the reported 710 Mb (0.32%) — is the paper rounding to whole Mb, confirmed against NCBI's own assembly_stats. The unreproduced items (MAKER 22,035, BUSCO ~3.3%) are honest 80/20 exclusions due to a non-deposited intermediate and BUSCO version drift, not authors-side or fabrication concerns. Central claims fully hold; no derivability or core-claim issues.

🤝
Reproduced automatically — and fairly

Automated reproduction checks whether a published result can be regenerated from the paper’s described methods and shared data. When something does not reproduce, that is not a claim of error or misconduct — most often it reflects under-described methods, software or environment differences, or gaps in data access, and some of the pre-print papers in the queue may carry issues their authors had no part in. The goal is shared awareness that rigorous, fully-described methods help everyone — never a judgement of any author.

Are you an author? We would genuinely like to hear from you — to clarify the record, add data or code, re-run the pipeline after an accession update, and publish your response right next to the assessment. Everything here is open and auditable.

🚩 Report an error in this record

Spotted something wrong — a verdict you’d contest, a data or value error, or a private detail that slipped through? Tell us, with a short justification. Authors and readers are equally welcome to write in; we review every report.

Prefer email, or the form below not working? Contact us at [email protected].

Reproduction footprint

claude-opus-4-8

Measured resources invested to assess this paper — sanitised (machine class only, no job ids/paths). Compute = HPC accounting (SLURM); tokens = the AI agent's session.

123.4 k
tokens (I/O) · 9 M incl. cache
15 min
runtime · 0.02 CPU-h
0.5 GB
peak RAM
1 (1 failed)
HPC jobs
hummel
machine