Task: Assemble the package once every input is present
Table of Contents
This page documents a task in the Gather each trade set and its market data — the remaining work story. It captures the goal, current status, acceptance, and any notes or results.
1. Goal
prepare_ore_package downloads whatever it is handed and packs it. If a
producer has not finished, or a producer failed, the step cannot tell: it
either reads a missing key and throws, or it packs what is there and the engine
discovers the gap when it reads the file. A run that is still gathering and a
run that is broken look the same until the engine speaks.
Make the step consume the run's declared artifact set, run only when every artifact exists, and name the ones that do not.
2. Status
| Field | Value |
|---|---|
| State | BACKLOG |
| Parent story | Gather each trade set and its market data — the remaining work |
| Now | Not yet started. |
| Waiting on | Declare what a step consumes and produces and Hold a workflow as a dependency graph |
| Next | Begin implementation. |
| Last touched | 2026-10-07 |
3. Acceptance
- The step dispatches only when every artifact the run declared exists.
- When one is missing, the run reports which artifact is missing and which step produces it, rather than failing inside the engine.
- The package is assembled from storage, so the step holds no state of its own that a restart would lose.
- The engine's working directory is still the layout ORE reads: the run
document and its configuration under
inputPath, and the run's own data at the paths the run document names.
4. Plan
This is the task that makes the waiting visible, and it depends on both foundations: the declaration says what the run needs, and the graph says whether each producer has finished. Assembling from storage rather than from a staging directory built inside one call is what lets the producers run anywhere and in any order.
ores.ore.store::declared_data_files already reads the names the run document
gives the run's own data, and archive_layout already places the configuration
documents where the engine reads them. The pieces the earlier change built are
the ones this step keeps; what changes is where the bytes come from and when
the step is allowed to start.
5. Measurements
Every number this task claims about a tree, with the command that produced it
and the commit it was measured at. A number without both is not a measurement,
because a clean-up record describes a tree and trunk moves under a branch: a
consumer count, a gate's component count and a suite's size all change with no
code changing, and the reader of a bare number cannot tell which tree it came
from. Where the raw output matters, put it in an evidence/ file beside the
task and name that file in the Command column.
| What | Value | Command | Commit |
|---|---|---|---|
6. Notes
7. Test Scenarios
Manual QA scenarios (scaffolded via compass add test_scenario)
that verify this task. Link
new ones here as they're created; the scenario doc itself links back
via its "Verifies task" field.
| Scenario | State | Notes |
|---|---|---|
8. PRs
| PR | Title |
|---|---|
9. Review
| Comment summary | File | Decision | Notes |
|---|---|---|---|