Story: Finish moving the hand-written SQL onto models
Table of Contents
This page documents a story in Sprint 30, carried unfinished from Sprint 28 at close. It captures the goal, current status, acceptance criteria, and the tasks that compose it.
1. Goal
Bring the last hand-written SQL under codegen: the four populate pipelines that predate the dataset archetypes, and the tables that have a codegen shape but no model. Every table and every loader is generated from a model, or the reason it is not is recorded.
2. Status
| Field | Value |
|---|---|
| State | BACKLOG |
| Parent sprint | Sprint 30 |
| Now | Not yet started. |
| Waiting on | Nothing. |
| Next | Break the story into tasks. |
| Last touched | 2026-11-08 |
3. Acceptance
- The four populate pipelines — FPML, crypto, flags and ip2country — are generated from the ores.codegen.dataset archetypes, or each is recorded with the reason it cannot be.
- Every table a codegen shape covers has a model, so its schema, drop, notify trigger and C++ come from one source.
- The tables that stay hand-written are listed with the reason, so the boundary is a statement rather than an omission.
- No hand-written table-creating SQL is left that a codegen shape could carry.
4. Tasks
| Task | State | Start | End | Description |
|---|---|---|---|---|
| Migrate FPML, crypto, flags and ip2country onto the org dataset pipeline | BACKLOG | Bring the four remaining populate pipelines onto the ores.codegen.dataset archetypes now that the populate archetypes are generic. | ||
| Model the hand-written tables that have a codegen shape | BACKLOG | Twenty-three tables have no model: junctions such as iam account roles and role permissions and the reporting risk report config books and portfolios, time series such as iam auth events and session samples, and the DQ publication logs. Model the ones a codegen shape covers and record why the rest, such as mq and telemetry, stay hand-written. |