bullitt/trackbox

[WSJF-7] Structured artifact handoff: save emails as golden test fixtures #6

New issue

Open

opened 2026-06-27 10:45:28 +02:00 by bullitt · 0 comments

bullitt commented

2026-06-27 10:45:28 +02:00

Owner

Context

Article: 'Use files to pass state between sessions.' Enables context resets while maintaining continuity.

Problem

When AI processes an email and generates good extraction, that knowledge is lost. If the parser later breaks, we have no reference data to test against.

Proposal

On each successful AI extraction, save the email + extraction as a JSON fixture in a fixtures/ directory
Use these as regression tests: re-run parsers against fixtures periodically
Enables evaluator step in CI (see issue #2)

WSJF: 7

## Context Article: 'Use files to pass state between sessions.' Enables context resets while maintaining continuity. ## Problem When AI processes an email and generates good extraction, that knowledge is lost. If the parser later breaks, we have no reference data to test against. ## Proposal - On each successful AI extraction, save the email + extraction as a JSON fixture in a `fixtures/` directory - Use these as regression tests: re-run parsers against fixtures periodically - Enables evaluator step in CI (see issue #2) ## WSJF: 7

bullitt added the

label

2026-06-27 10:45:28 +02:00

bullitt referenced this issue

2026-06-27 15:41:14 +02:00

Dashboard: Add dense shipment list view for operational scanning #27

bullitt referenced this issue from a commit

2026-06-27 17:09:53 +02:00

security: implement all 10 expert findings — auth, key protection, input sanitization, rate limiting, error scrubbing, non-root container

bullitt referenced this issue from a commit

2026-06-27 17:09:53 +02:00

refactor: implement architect findings — auth, scrape_log retention, settings cache, DB indexes, async ingest, metrics, retention consolidation

bullitt referenced this issue from a commit

2026-06-27 17:09:53 +02:00

feat: implement PM findings — manual add, ETA field, stalled reset, webhook notifier, ETA highlight, bulk archive

bullitt referenced this issue from a commit

2026-06-28 16:10:38 +02:00

security: implement all 10 expert findings — auth, key protection, input sanitization, rate limiting, error scrubbing, non-root container

bullitt referenced this issue from a commit

2026-06-28 16:10:38 +02:00

refactor: implement architect findings — auth, scrape_log retention, settings cache, DB indexes, async ingest, metrics, retention consolidation

bullitt referenced this issue from a commit

2026-06-28 16:10:38 +02:00

feat: implement PM findings — manual add, ETA field, stalled reset, webhook notifier, ETA highlight, bulk archive

Sign in to join this conversation.

No labels

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference

bullitt/trackbox#6

No description provided.