Microglia maintain structural integrity during fetal brain morphogenesis.
The main results reproduced, with only marginal, non-material deviations.
Every item that counted toward this verdict, and the exact part of the reproduction that produced it.
- Nothing in this column.
- 🟡Could not use the authors’ exact input data
- 🟡Reported values were only indirectly comparable
- 🟡A deviation arose in the data or preprocessing
- 🟡A deviation was attributed to the published material
- 🟡Reported values were not (fully) derivable from the shared data
- 🟡The deviation was non-trivial in magnitude
- 🟡The central claim did not (fully) hold under reproduction
- 🟡Overall, the reproduction showed a material discrepancy
A 0–100 reproducibility-quality score from the per-question grades, shown as a z-score: standard deviations above (+) or below (−) the mean of comparable assessments.
▸Reproduction agent’s raw note
Described well enough to reproduce the pipeline DATA point, with an important provenance caveat. The harvester's RU links are partly off-target: the linked code (github.com/satijalab/sctransform) is NOT the authors' own repo but IS the paper's genuine normalization tool (P16-valid); the linked data GSE121654 is NOT the authors' own data but Hammond et al. 2019 (PMID 30471926), which the paper REUSES (authors' own scRNA-seq is in ArrayExpress E-MTAB-13581, not linked). On «our HPC»/«infra» I (1) downloaded GSE121654_RAW.tar (sha256 b7f4747..., 47 Drop-seq DGE matrices) and counted 114,050 deposited barcodes vs the paper's reported 76,149 post-QC reanalyzed cells -- consistent (76,149 is a QC subset of 114,050), not a mismatch; (2) ran the linked tool SCTransform(glmGamPoi) end-to-end on the merged data (110,513 post-QC cells -> 3,000 variable genes -> 25 clusters), demonstrating the linked pipeline reproduces on the linked data. NOT a 1:1 of the exact 76,149 integer: that requires the authors'/Hammond's private tSNE coordinates + cluster labels ('provided by the authors'), not in the public deposit -- a data-provenance limitation, NOT a fabrication signal (76,149 is independently anchored to the GSE121654 title). NOT attempted (the hard 20%): the 2,517-ATM sub-count, the authors' own E-MTAB-13581 data (115,256 cells), the La Manno reuse (229,948 / 1,711 cells), and all wet-lab/imaging/Metascape results (non-pipeline). Verdict: partial reproduction with no fabrication concern detected; a human reviewer should confirm via AUDIT.md.
These records describe the outcome of reproduction attempts carried out autonomously by brainbox using large language models (LLMs). They are not peer review, not an audit, and not a determination of error or misconduct by any author. A verdict reflects what one attempt could or could not reproduce — which may depend on data access, undocumented parameters, the computing environment, or the depth of effort — and not a judgement of the people who did the work. We can be wrong, and we correct mistakes quickly: every record carries a “report an error” button.
Assessment versions
Every reproduction run is kept as an immutable version — anchored to the data as it stood, with a tamper-evident chain hash. A rerun (e.g. after an author updates a deposit) adds a new version; the previous one stays on record.
-
v1 current initial assessment Score 68assessed: 2026-06-15 ⛓ 9fe71fa8a79d
✎ I am an author of this paper
Updated or fixed a deposit, or is there an erratum? Ask us to re-run the metrics. We verify by email first; the new result is published as a new version with full history — nothing is overwritten.
Provenance — full disclosure
When this reproduction was carried out, which methodology version was used, and by whom — so the record can be audited and checked independently.
- Reproduced
- 2026-06-15
- Rubric version
- v1.0
- Assessed by
-
🤖 AI curator · claude (ai-curator room) · v1.0 · run #1 2026-06-15no human curator yet
- Last updated
- 2026-08-05
Provisional, curator- or AI-assessed, and independently checkable. A reproduction outcome states what one attempt could reproduce — not a judgement of the authors.
Deep full-text extraction
Model: opusDo embryonic microglial transient accumulations in the fetal brain represent cells in specific transcriptomic states, and do these microglia serve a functional role in maintaining the structural integrity of cortical boundaries during brain morphogenesis?
- ★ ATM-like microglia accumulate at two embryonic cortical boundaries, the cortico-striato-amygdalar boundary (CSA) and cortico-septal boundary (CSB) finding
- ★ Embryonic ATM-like microglia share a core transcriptomic and protein signature (Spp1/OPN, Csf1, Igf1, Lgals3/Mac2, Gpnmb, CD11c, Clec7a) with post-natal axon-tract-associated microglia (ATM/PAM) finding
- ★ Microglia maintain structural integrity at these boundaries by preventing the formation of large cavitary lesions caused by morphogenetic stress finding
- ★ The ATM-core factor Spp1/osteopontin contributes to the neuroprotective function of microglia at cortical boundaries mechanism
- ★ Microglia and Spp1 contribute to the rapid repair of cavitary lesions finding
- ★ The ATM-like accumulation pattern at the CSA is conserved in human fetal brain (GW9–GW14) finding
- Embryonic ATM-like microglia are highly phagocytic with amoeboid morphology and elevated CD68, distinguishing them from neighboring ramified microglia finding
- Csf1r ΔFIRE/ΔFIRE mice provide a model lacking microglia while retaining other brain macrophages to interrogate microglia-specific roles method
| Assay | System | Perturbation | Readout | Platform |
|---|---|---|---|---|
| single-cell RNA-seq (re-analysis of published dataset) | mouse embryonic brain microglia (La Manno dataset, E9–E18) | none | microglial transcriptomic clusters / ATM gene signature | — |
| immunolabeling / immunohistochemistry | mouse brain sections (Cx3cr1gfp/+ and CD11c-EYFP embryos, E14.5–E18.5) | none | co-expression of microglia (P2Y12, IBA1, GFP) and ATM markers (CD11c, Mac2, Clec7A, Spp1, GPNMB) at CSA/CSB | — |
| immunolabeling / immunohistochemistry | human fetal brain transverse sections (GW9–GW14) | none | co-expression of ATM markers with IBA1 at CSA | — |
| antibody-mediated microglial depletion | mouse embryos (Cx3cr1gfp/+), maternal IP injection | CSF1R-blocking antibody AFS98 at E6.5/E7.5 | microglial depletion and presence of cavitary lesions at CSA/CSB | — |
| pharmacological microglial depletion | mouse embryos, maternal feeding | PLX3397 (CSF1R inhibitor) E6.5–E15 or E12.5–E15 | microglial depletion and cavitary lesion formation | — |
| genetic depletion / mutant analysis | mouse embryos (Csf1r ΔFIRE/ΔFIRE; Pu.1 mutants) | microglia-specific KO / myeloid loss | cavitary lesions at CSA/CSB | — |
| electron microscopy | mouse embryo CSA cavitary lesions (PLX3397-treated) | PLX3397 microglial depletion | ultrastructure of cavities (membrane debris, absence of cells/basal lamina) | — |
| pHrodo phagocytosis assay / CD68 immunolabeling | ex vivo mouse brain slices (E14.5) | none | phagocytic activity and CD68 coverage of CSA vs neocortical microglia | — |
- – Three microglial clusters identified in embryonic brain: cycling, non-cycling, and embryonic ATM-like MG, with ATM-like present from E14 onward n=1,711 microglial cells
- ▲ Approximately 60% of CSA microglia co-expressed ATM core signature proteins (CD11c, Mac2, Clec7A, Spp1, GPNMB) ~60%
- ▲ Approximately 70% of microglia accumulating at the CSB co-expressed ATM markers at E18.5 ~70%
- ▲ Lack of microglia induced a large cavitary lesion at the CSA starting at E14.5 and persisting until E18.5 across all depletion/mutant models
- ▲ Absence of microglia induced midline cavitary lesions at the CSB where ATM-like MG normally accumulate
- ▲ CSA ATM-like microglia showed higher CD68 coverage than neighboring SPP1-negative ramified microglia
- – No cavitary lesions observed in Cx3cr1, Dap12/TyroBP, CR3 mutants or maternal immune activation models
- – Conserved pattern of ATM-core-expressing microglia at the CSA in human fetal brain from GW9 to GW14
- count n = 1,711 embryonic microglial cells extracted (microglia extracted from La Manno scRNA-seq dataset for UMAP analysis)
- count 76,149 cells characterized by scRNA-seq (total cells in La Manno tSNE dataset)
- fold_change FC > 1.5, Bonferroni-adjusted p < 1e-10 (DEG thresholds for embryonic vs post-natal ATM overlap (Venn diagram))
- count ~60% (fraction of CSA microglia co-expressing ATM core markers)
- count ~70% (fraction of CSB microglia co-expressing ATM markers at E18.5)
- count nNcx = 28, nCSA = 29 cells in 4 mice from 2 litters (CD68 coverage comparison SPP1-negative ramified vs SPP1-positive CSA ATM)
- count E14.5 nControls=21, nAFS=6; E18.5 nControls=15, nAFS=17 (AFS98 antibody depletion confirmation)
- count E14.5 nControls=5, nPLX3397=5; E18.5 nControls=12, nPLX3397=11 (PLX3397 E6.5–E15 depletion confirmation)
Statistical methods review
Model: opusA neutral, descriptive read of the statistical approach — what was done, and (for shared learning, not as criticism) what could also have been done.
The study combines single-cell transcriptomic re-analysis of published datasets with imaging-based quantification in genetically modified and pharmacologically treated mouse models. Differential gene expression between microglial clusters was assessed with fold-change thresholds and Bonferroni-adjusted p values, while quantitative comparisons of marker co-expression and cellular measures between anatomical regions or experimental groups were made with non-parametric tests. Results were reported as means ± SEM with significance indicated by p-value thresholds, and sample sizes were given as numbers of cells and/or embryos per condition.
| Test | Applied to | n | Assumptions |
|---|---|---|---|
| Mann-Whitney U test | comparisons of ATM marker co-expression and CD68 coverage between neocortex and CSA microglia (Figure S1, e.g., S1I, S1K) | e.g., n_Ncx = 28, n_CSA = 29 cells in 4 mice from 2 litters (CD68 coverage); other comparisons from at least 3 mice from 2 litters | not stated |
| Differential expression with fold-change threshold and Bonferroni-adjusted p value | identification/overlap of embryonic vs post-natal ATM DEGs (Figure 1D; Venn diagrams) | FC > 1.5, Bonferroni-adjusted p < 1e-10; based on cells in scRNA-seq datasets (e.g., n = 1,711 microglial cells extracted) | not stated |
-
Group differences in marker co-expression and CD68 coverage were assessed with the Mann-Whitney U test.↳ Could also: A parametric two-sample t-test (with a normality check), or a mixed-effects model that nests cells within mice/litters, could also have been used. — A mixed-effects/hierarchical model would explicitly account for cells being clustered within animals and litters, and would treat the animal as the unit of replication; this can be informative when many cells come from a few mice.
-
Dispersion was summarized as means ± SEM.↳ Could also: Standard deviation or a 95% confidence interval could also be reported, optionally alongside individual data points. — SD conveys the spread of the data and a CI conveys precision of the estimate; both are often favored for small samples and make the variability directly interpretable to readers.
-
Significance was reported as p-value thresholds (*, **, ***).↳ Could also: Exact p values together with effect-size estimates (e.g., differences in means or rank-biserial correlation) and their confidence intervals could also be presented. — Exact p values and effect sizes give a fuller, quantitative picture of the magnitude and certainty of an effect beyond a binary threshold.
-
Differential expression used a fold-change cutoff with Bonferroni-adjusted p values.↳ Could also: A Benjamini-Hochberg false discovery rate approach, or model-based single-cell DE frameworks (e.g., MAST, DESeq2, or pseudobulk per animal), could also be applied. — FDR control is often preferred in high-dimensional genomics for its sensitivity, and pseudobulk/model-based methods can better account for biological replicate structure in single-cell data.
-
Multiple pairwise comparisons across regions and several depletion models were each evaluated individually.↳ Could also: A single ANOVA (or its non-parametric Kruskal-Wallis analog) with a post-hoc multiple-comparison correction could also be used when more than two groups are compared. — An omnibus test with post-hoc correction controls the family-wise error rate across the set of related comparisons within an experiment.
-
Sample sizes were reported as observed counts of embryos and cells per condition.↳ Could also: An a priori power/sample-size justification could also accompany these counts. — A stated power analysis clarifies the effect size the study was designed to detect and supports interpretation of comparisons with smaller group sizes.
Result convergence & founder nodes
Findings this paper shares with others that ran a comparable experiment. A node’s strength is how many independent papers report it (replication breadth) — not how often it is cited, so a heavily-replicated but under-cited founder still stands out.
-
ATM-core-marker-expressing microglia are present at the CSA in human fetal brain from GW9 to GW14, demonstrating cross-species conservation of this developmental microglial subtype.imaging human fetal brain 2024×1papers★ This paper is the founder (earliest)
-
Approximately 60% of microglia at the CSA co-express ATM core proteins (CD11c, Mac2, Clec7A, SPP1, GPNMB), indicating selective enrichment of ATM-like microglia at this embryonic brain boundary.imaging mouse embryonic brain up 2024×1papers★ This paper is the founder (earliest)
-
No cavitary lesions arise in Cx3cr1, Dap12/TyroBP, or CR3 mutants or in maternal immune activation models, indicating the structural phenotype requires total microglial loss rather than general immune or signalling perturbation.imaging mouse embryonic brain none 2024×1papers★ This paper is the founder (earliest)
-
Microglial depletion by antibody, pharmacological, or genetic means induces cavitary lesions at the corpus callosum anlage from E14.5, demonstrating that ATM-like microglia are required for structural integrity at this boundary.imaging mouse embryonic brain up 2024×1papers★ This paper is the founder (earliest)
-
ATM-like microglia at the CSA show higher CD68 coverage than neighboring SPP1-negative ramified microglia, indicating elevated phagocytic activity at the embryonic brain boundary.imaging mouse embryonic brain up 2024×1papers★ This paper is the founder (earliest)
-
Re-analysis of published scRNA-seq data identifies a distinct embryonic ATM-like microglial cluster in mouse brain present from E14 onward, alongside cycling and non-cycling populations.scRNA-seq mouse embryonic brain 2024×1papers★ This paper is the founder (earliest)
Citation network
Where this publication sits in the reproducibility-weighted citation graph — what it is built on, and what is built on it. Citation data from OpenAlex.
No assessed neighbours yet — the network grows as more papers are assessed.
Data lineage
The datasets this paper uses (text-mined from the full text via Europe PMC), and which other assessed papers stand on the same data. A shared dataset is a factual link — not a judgement.
What was reproduced
The exact results taken into scope, with each reported value next to the value our attempt produced.
Scope — pmid-38309258
Paper: Lawrence AR, Canzi A, Bridlance C, … Garel S. "Microglia maintain structural integrity during fetal brain morphogenesis." Cell 187(4):962-980.e19, 2024-02-15. DOI 10.1016/j.cell.2024.01.012 · PMCID PMC10869139.
RU-linked artifacts (as harvested) — verified
| Artifact | RU link | Reality (verified) |
|---|---|---|
| Code | github.com/satijalab/sctransform | Legit & used by the paper. Methods cite "SCTransform v0.3.5" + glmGamPoi v1.10.2 (RRID SCR_014601) for normalization/scaling. NOT the authors' own analysis repo (they ship no own repo), but P16-valid: the linked third-party tool IS part of the paper's pipeline. |
| Data | geo:GSE121654 | Reused external dataset, not the paper's own. GSE121654 = Hammond et al. 2019 (PMID 30471926, Stevens lab), "76,149 microglia across the mouse lifespan." The Lawrence paper reanalyzes it (postnatal ATM signature; Table S1). The paper's OWN scRNA-seq is deposited separately under ArrayExpress E-MTAB-13581. |
Reproducible pipeline-derived results (in scope)
The paper's computational outputs come from a standard Seurat (v4.1.1) + SCTransform (v0.3.5, glmGamPoi) workflow applied to three scRNA-seq datasets:
| # | Reported value | Dataset | Pipeline | Paper location |
|---|---|---|---|---|
| C1 | 76,149 cells (incl. 2,517 ATM) reanalyzed | GSE121654 (Hammond, RU-linked) | filter + reuse authors' tSNE/cluster labels | Results / Fig. legend "tSNE of the 76,149 cells" |
| C2 | 115,256 cells sequenced (5,830 M reads) | E-MTAB-13581 (own) | CD45+ purification → SCTransform → PCA(5 PCs) → UMAP | Methods / STAR |
| C3 | 229,948 cells reused | La Manno loom (mousebrain.org) | reuse | Methods |
| C4 | 1,711 cells (510 atm, 415 cycling, 786 non-cycling) | La Manno subset | filter ≥10 cells/gene | Results |
What we attempt (80/20)
- PRIMARY (C1): Download the RU-linked GSE121654 deposited DGE matrices on «infra», sum per-sample cell-barcode counts, compare to the reported 76,149. Uses BOTH RU-linked artifacts. Cheap, crisp, falsifiable.
- SECONDARY (tool run): Execute the RU-linked tool SCTransform v0.3.5 (Seurat + glmGamPoi) on the GSE121654 matrices per the paper's stated parameters; report derived stats (variable genes, PCs, clusters) — demonstrates the linked pipeline runs on the linked data and yields sensible output.
Out of scope / not attempted (the hard 20%)
- The 2,517-ATM sub-count and reproduced tSNE coordinates depend on cluster labels the authors obtained privately from the Hammond authors ("coordinates and reported clusters were provided by the authors") — not derivable from the public deposit. Skipped.
- C2 (E-MTAB-13581) own-data full reprocessing: feasible but heavier; attempt only if cheap. The 115,256 figure is a sequencing/loading count, weakly pipeline-derived.
- All wet-lab, imaging (Imaris), Metascape enrichment, electrophysiology — out of scope (non-pipeline).
Honesty notes (possible-fabrication watch)
- 76,149 is independently checkable: it is the title number of GSE121654, so it is a strong external anchor. Deposited raw barcode columns may EXCEED 76,149 (raw DGE before the authors' final QC) — any gap is expected and reported, not a mismatch in the paper.
Assessments & scoring basis
Each contributor’s verdict, the per-question basis, and the auditable, itemised worksheet behind it.
An automated assessment. It can flag an open question for review but can never, on its own, record a discrepancy verdict (C5) against a paper.
Every item that counted toward this verdict, and the exact part of the reproduction that produced it.
This is a partial, pipeline-level reproduction with no fabrication concern. The RU-linked data (GSE121654) is reused Hammond et al. 2019 data, and the linked code (satijalab/sctransform) is the paper's genuine normalization tool, which ran end-to-end (110,513 cells → 25 clusters) with only minor version drift. The single comparable number, 76,149 post-QC cells, is consistent with the 114,050 deposited barcodes (a QC subset) and is independently anchored to the GSE121654 title, but it is not recoverable 1:1 because Hammond's/the authors' private tSNE coordinates and cluster labels were not deposited. The deviations are input-side (cohort/QC definition + data provenance), on our-method/data-availability side rather than the authors' — moderate in magnitude and fully explainable, so overall yellow.
Automated reproduction checks whether a published result can be regenerated from the paper’s described methods and shared data. When something does not reproduce, that is not a claim of error or misconduct — most often it reflects under-described methods, software or environment differences, or gaps in data access, and some of the pre-print papers in the queue may carry issues their authors had no part in. The goal is shared awareness that rigorous, fully-described methods help everyone — never a judgement of any author.
Are you an author? We would genuinely like to hear from you — to clarify the record, add data or code, re-run the pipeline after an accession update, and publish your response right next to the assessment. Everything here is open and auditable.
🚩 Report an error in this record
Spotted something wrong — a verdict you’d contest, a data or value error, or a private detail that slipped through? Tell us, with a short justification. Authors and readers are equally welcome to write in; we review every report.
Prefer email, or the form below not working? Contact us at support@doesitreproduce.com.
Reproduction footprint
claude-opus-4-8Measured resources invested to assess this paper — sanitised (machine class only, no job ids/paths). Compute = HPC accounting (SLURM); tokens = the AI agent's session.