Corpus 1,272 assessed · 1,173 scored · 643 reproduced ≥75 · 168 flagged ·∅ 74.1/100
← New search

KCNQ4, a novel potassium channel expressed in sensory outer hair cells, is mutated in dominant deafness.

Cell · 1999
L1 88/100 1/4
Why this verdict

The main results reproduced: recomputed values matched the published ones within tolerance.

Reproduced on the brainbox compute brainarbeit.com
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Supporting (toward a concern)
Content-critical question only partially held
+2 pts
From: Q8 · Severity of the miss (overall human judgment) 🟡
Minor / cosmetic deviation
+1 pts
From: Q3 · Location of the main deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q2 · Endpoint comparability 🟡
Total score +4
✓ What held up
  • No authors-side cause for any deviation
  • Reported values are derivable from the shared data
  • Any deviation was negligible
  • The central claim held under reproduction
What did not (or only partly)
  • 🟡Could not use the authors’ exact input data
  • 🟡Reported values were only indirectly comparable
  • 🟡A deviation arose in the data or preprocessing
  • 🟡Overall, the reproduction showed a material discrepancy
How its reproducibility compares
88/100
Reproducibility score
0.8 SD above mean
vs. all fields · 1173 studies
🎯 Scores higher than 74% of all assessed papers rank 276 of 1173 scored

A 0–100 reproducibility-quality score from the per-question grades, shown as a z-score: standard deviations above (+) or below (−) the mean of comparable assessments.

Reproduction agent’s raw note

1999 positional-cloning paper (pre-genomic era): nearly all reported results are wet-lab (cloning, FISH/YAC mapping, RT-PCR, in situ hybridization, pedigree linkage, Xenopus oocyte electrophysiology) and out of scope for pipeline reproduction — not attempted. The one pipeline-derived result, Figure 1's ClustalX dendrogram + reported %-identity values, WAS reproduced on «our HPC» using Clustal Omega (ClustalX's modern successor) on the paper's own deposited KCNQ4 sequence (AF105202) plus current UniProt canonical comparator sequences (exact 1998 comparator accessions are not stated in the paper). Qualitative topology (KCNQ1-4 monophyletic, more divergent internally than Kv1.1-1.4) reproduces cleanly; %-identity values reproduce within 2-6 points with identical rank order. The paper's only dataset (its own GenBank deposit, 15 accessions) is fully complete and matches its own description. No GEO/SRA/other public omics dataset is used by this paper. Status is 'partial': the sole in-scope pipeline claim reproduces at within-tolerance/exact grades, but the paper's overwhelming majority of results are out-of-scope wet-lab work that was correctly not attempted.

These records describe the outcome of reproduction attempts carried out autonomously by brainbox using large language models (LLMs). They are not peer review, not an audit, and not a determination of error or misconduct by any author. A verdict reflects what one attempt could or could not reproduce — which may depend on data access, undocumented parameters, the computing environment, or the depth of effort — and not a judgement of the people who did the work. We can be wrong, and we correct mistakes quickly: every record carries a “report an error” button.

✎ I am an author of this paper

Updated or fixed a deposit, or is there an erratum? Ask us to re-run the metrics. We verify by email first; the new result is published as a new version with full history — nothing is overwritten.

Reason for the rerun

We email you a confirmation link first. The rerun is an objective re-measurement — it cannot change the verdict in your favour, only ask us to look again.

Provenance — full disclosure

When this reproduction was carried out, which methodology version was used, and by whom — so the record can be audited and checked independently.

Reproduced
2026-07-28
Rubric version
v1.0
Assessed by
🤖 AI curator · claude (ai-curator room) · v1.0 · run #1 2026-07-31
no human curator yet
Last updated
2026-07-31

Provisional, curator- or AI-assessed, and independently checkable. A reproduction outcome states what one attempt could reproduce — not a judgement of the authors.

What was reproduced

The exact results taken into scope, with each reported value next to the value our attempt produced.

fig1b_dendrogram_topology
Reported
KCNQ1-4 form a distinct monophyletic branch of the K+ channel superfamily, less related to each other (more divergent) than Kv1.1-Kv1.4 are to each other (ClustalX, default parameters).
Reproduced
Clustal Omega 1.2.4 guide tree: KCNQ1/2/3/4 form one monophyletic clade separate from the Kv1.1-1.4/Kv2.1/Kv3.1/Kv4.1 clade; within-KCNQ branch lengths (0.25-0.34) exceed within-Kv1.x branch lengths (0.11-0.19), confirming greater intra-family divergence.
within tolerance
kcnq4_vs_kcnq1_identity
Reported
38% overall amino acid identity (KCNQ4 vs KCNQ1)
Reproduced
35.9% (pairwise global, BLOSUM62); 32.4% (MSA-column)
within tolerance
kcnq4_vs_kcnq2_identity
Reported
44% overall amino acid identity (KCNQ4 vs KCNQ2)
Reproduced
42.7% (pairwise global, BLOSUM62); 40.7% (MSA-column)
within tolerance
kcnq4_vs_kcnq3_identity
Reported
37% overall amino acid identity (KCNQ4 vs KCNQ3)
Reproduced
36.3% (pairwise global, BLOSUM62); 32.2% (MSA-column)
within tolerance
genbank_deposit_completeness
Reported
KCNQ4 cDNA deposited as AF105202; exons/introns deposited as AF105203-AF105216 (15 accessions total)
Reproduced
All 15 accessions (AF105202-AF105216) resolve live via NCBI esummary, all Homo sapiens, titles consistent with 1 mRNA + 14 exon records matching the paper's stated 14-exon gene structure
exact

Assessments & scoring basis

Each contributor’s verdict, the per-question basis, and the auditable, itemised worksheet behind it.

🤖 AI curator · claude (ai-curator room) · v1.0 L1 88/100

An automated assessment. It can flag an open question for review but can never, on its own, record a discrepancy verdict (C5) against a paper.

🟡1. Data identity
🟡2. Endpoint comparability
🟡3. Location of the main deviation
🟢4. Cause of the deviation
🟢5. Derivability / plausibility
🟢6. Severity of the deviation
🟢7. Core claim
🟡8. Severity of the miss (overall human judgment)
Scoring basis — itemised

Every item that counted toward this verdict, and the exact part of the reproduction that produced it.

Supporting (toward a concern)
Content-critical question only partially held
+2 pts
From: Q8 · Severity of the miss (overall human judgment) 🟡
Minor / cosmetic deviation
+1 pts
From: Q3 · Location of the main deviation 🟡
Minor / cosmetic deviation
+1 pts
From: Q2 · Endpoint comparability 🟡
Total score +4

Only one claim of this 1999 positional-cloning paper is pipeline-reproducible — Fig. 1's ClustalX dendrogram and the KCNQ4-vs-KCNQ1/2/3 identities of 38%/44%/37% — and it reproduces well: pairwise-global gives 35.9%/42.7%/36.3% with the rank order KCNQ2 > KCNQ1 > KCNQ3 preserved, and the guide tree recovers a monophyletic KCNQ1-4 clade with within-family branch lengths (0.25-0.34) exceeding within-Kv1.x lengths (0.11-0.19), which is precisely the paper's qualitative assertion. The 2-6 point numeric gap sits on our/technical side (Clustal Omega substituted for the obsolete ClustalX; present-day UniProt canonicals substituted for unstated 1998 comparator accessions), not on the authors' — the paper simply never specified those inputs. The paper's own dataset is clean: all 15 stated accessions AF105202-AF105216 resolve live as Homo sapiens KCNQ4 records (1 mRNA + 14 exons), matching the described 14-exon structure; no fabrication or too-perfect signal. Overall yellow: the verified part is solid and the deviations are fully explainable, but the reproduction touches only Fig. 1 while Figs. 2-6 (mapping, in situ, G285S pedigree, oocyte electrophysiology) are wet-lab and untested.

🤝
Reproduced automatically — and fairly

Automated reproduction checks whether a published result can be regenerated from the paper’s described methods and shared data. When something does not reproduce, that is not a claim of error or misconduct — most often it reflects under-described methods, software or environment differences, or gaps in data access, and some of the pre-print papers in the queue may carry issues their authors had no part in. The goal is shared awareness that rigorous, fully-described methods help everyone — never a judgement of any author.

Are you an author? We would genuinely like to hear from you — to clarify the record, add data or code, re-run the pipeline after an accession update, and publish your response right next to the assessment. Everything here is open and auditable.

🚩 Report an error in this record

Spotted something wrong — a verdict you’d contest, a data or value error, or a private detail that slipped through? Tell us, with a short justification. Authors and readers are equally welcome to write in; we review every report.

Prefer email, or the form below not working? Contact us at support@doesitreproduce.com.