Skip to content

Reproducibility ​

This page records the reproduction path for the public execution-kernel claim.

The versioned workflow benchmark records the paper evaluation and later implementation results separately.

Target Release ​

FieldValue
Packageculsma
Releasev1.0.9
Python>=3.11
Runtime dependencylark>=1.1.0

Install ​

bash
python -m pip install "culsma==1.0.9"

Smoke Run ​

bash
culsma run path/to/protocol.culs --artifacts-dir tmp/run

Use a local .culs source file. Public PyPI installs do not include bundled example protocol files.

Expected artifact names:

  • summary.json
  • ast.json
  • ir.json
  • validate.json
  • typecheck.json
  • plan.json
  • run.json
  • output.json
  • result.json

output.json is the machine-readable run output. Its returns field contains protocol return values, and its report field contains the derived lab_report_v1 report.

Verified smoke result:

FieldValue
runtime_oktrue
failed_steps0
skipped_steps0
semantic/type/plan/runtime diagnostics0

Replay ​

bash
culsma replay --run-json tmp/run/run.json --out tmp/replayed_state.json

Replay should reconstruct state from run.json without requiring the original source file:

FieldValue
inputtmp/run/run.json
outputtmp/replayed_state.json

Tests ​

bash
python -m pytest -q

Caveat ​

Offline wheel installation requires dependency availability for lark.

Released under the Apache-2.0 license.