Exact Store replayΒΆ
MuscleAction.actuator_setpoints is the historical proposed action,
captured before actuator post-filters. It remains available for compatibility.
MuscleAction.applied_actuator_setpoints is the final post-filter action and
therefore the action returned to the SimulationController for environment
execution and used by exact Store-backed replay when present.
An ordinary replay definition remains backwards compatible. Exact sequential pretraining opts in to immutable source selection and validation:
replay:
- agent: teacher
experiment_run: teacher-run
instance: immutable-instance-uid
phase: 1
mode: train
strict: true
repeat: 1
Strict replay requires selected rows to contain an applied action, worker and
monotonic decision identity, reward, and explicit terminated/truncated
flags consistent with done. It rejects duplicate/non-monotonic decisions,
missing fields, empty selections, and more than one worker in a source. Rows
are ordered by worker, episode, decision index, then Store ID; each episode is
placed in its own Memory shard so successors never cross an episode boundary.
All sequential Store replay rejects a source containing more than one worker:
interleaving independent worker trajectories would otherwise fabricate
adjacency. Strict mode additionally requires exact fields and raises setup
errors; non-strict mode retains its best-effort legacy proposed-action fallback.
The columns are nullable by design. Existing databases are upgraded through
Alembic revision d21a0b4c6e7; legacy replay continues to use the historical
proposed-action field on a best-effort basis.