NMD-VCell Disease Virtual Cell Platform Specify a cell-state question, inspect computability, and design the missing test Module: Benchmark center · evidence-to-experiment workflow NMD = neuromuscular disorders

Current limit: the site can compare existing evidence, but no candidate has yet been independently repeated in a DMD muscle model.

Research evidence only 21 observed HepG2 perturbations 0 independent DMD replications Boundary & release
Observed HepG2 perturbations with limited external myogenic context No validated DMD perturbation prediction v1.0.0-database-resource Frozen 25 Jul 2026 Schema 1.1 Model ridge-safe-v2.3 Benchmark repeated-fold-v2.2 Build EA-20260730-36 DOI pending Open evidence boundary →

Distribution-level virtual cell

Predict a population of possible cell states—not one average vector.

The scientific object is a perturbation-conditioned cell distribution: who responds, which states expand or disappear, how uncertain the transition is, and when the model must abstain.

Prediction object

One input population becomes five auditable outputs.

Contract available · execution locked
InputControl cell populationcell type · disease context · donor · state · time · dose
+
ConditionGene, drug or combinationmodality · direction · target identity · requested sample size
Future generatorConditional transport / flow / diffusionMust beat permanent simple baselines on the same holdout
01Generated cellscell × gene matrix with sample identity
02State mixtureresponder fractions and occupancy shifts
03Pseudobulk effectmean effect retained for baseline comparison
04Uncertaintyintervals, calibration and OOD flags
05Abstentionexplicit refusal when support is insufficient

Current boundary: this page defines the future output object and evaluation rules. It does not generate synthetic DMD cells or a therapeutic prediction.

Model strategy

Build in three layers; never skip the baseline layer.

Open Model Center →
Layer 1 · executable now

Statistical and hybrid baselines

Zero, train mean, pseudobulk, ridge and nearest neighbour establish whether a complex model adds information.

Current state: limited same-context ridge run
Layer 2 · registered

Conditional state transport

Predict movement from a control population to a perturbed population while conditioning on gene, cell state and context.

Current state: no qualifying DMD training truth
Layer 3 · locked

Distribution-generative model

Flow or diffusion can represent heterogeneous responders, but only after cell-level truth and leakage-safe OOD splits exist.

Current state: architecture watch only

Metric firewall

Seven metric families prevent one convenient score from defining success.

No single composite leaderboard score
01

Mean fidelity

MAE · RMSE · correlation

Checks average expression without treating it as the whole response.

02

Differential response

DES · signed LFC · AUPRC

Tests whether perturbation-responsive genes and direction are recovered.

03

Perturbation identity

PDS + scale diagnostics

Tests discrimination while guarding against amplitude manipulation.

04

Population geometry

MMD · energy · Wasserstein / OT

Compares predicted and observed cell distributions.

05

State composition

state-proportion error · divergence

Tests responder fractions and shifts in cell-state occupancy.

06

Uncertainty

coverage · Brier · abstention

Tests whether confidence is calibrated and refusal is useful.

07

DMD utility

hit rate · replication · toxicity miss rate

Connects molecular prediction to disease-relevant function and safety.

PDS safeguardRaw PDS is never reported alone.
  • Report raw, truth-norm-matched and prediction-norm-matched variants.
  • Run amplitude scaling and normalization sensitivity checks.
  • Publish DES, MAE and distribution metrics beside PDS.
  • Freeze preprocessing and distance definition before scoring.
Metric sensitivity preprint →

Arc Virtual Cell Challenge watch

Confirmed facts are separated from launch-day unknowns.

Checked 30 Jul 2026
2025 · completed

What the first challenge established

  • More than 5,000 registrants and over 300 final submissions.
  • Hybrid deep-learning plus classical statistical features led the final rankings.
  • Models did not consistently beat naive baselines across every metric.
Arc official recap →
2026 · officially announced

What is confirmed now

  • Launch: Thursday, 20 August 2026.
  • Round two will use a new prediction problem and a wider range of metrics.
  • Grand prize: US$100,000.
Arc official announcement →
Rules pending

What remains unknown

  • Training and test datasets.
  • Exact perturbation, context and output contract.
  • Metric formulas, weights and submission format.
No compatibility claim until launch documents are bound.
Launch-day trigger

What NMD-VCell will do

  1. Freeze official files and checksums.
  2. Map task fields to the local contract.
  3. Run leakage and baseline audits.
  4. Register compatible and incompatible fields.
Readiness is not a competition score.

What can be used now

Adopt the evaluation architecture before training the generator.

Use nowDistribution output schema

Standardize future cell-level predictions and force uncertainty plus abstention.

Use nowMetric firewall

Protect against scale-sensitive PDS and misleading single-metric gains.

Use nowHybrid baseline stack

Keep pseudobulk, ridge and nearest-neighbour comparisons permanent.

Cannot claimDMD population simulation

No released DMD candidate-perturbation cell distribution exists for calibration.

Primary-source ledger

Published facts, official announcements and preprints keep different labels.