[WSJF-2] Automatic compaction: merge similar parsers #20

New issue

Open

opened 2026-06-27 10:46:15 +02:00 by bullitt · 0 comments

bullitt commented

2026-06-27 10:46:15 +02:00

Owner

Context

Article: 'Compaction preserves continuity.' Parsers accumulate over time.

Problem

We have multiple parsers for similar email types (e.g., DHL 'kommt heute' with slightly different fingerprints from pre-normalization era). They waste space and might have inconsistent quality.

Proposal

Script: find parsers with same sender_domain and overlapping keywords
Compare their field_maps — if identical or near-identical, merge (keep higher use_count)
Run periodically or add to admin UI

WSJF: 2 (Low value, Low urgency)

## Context Article: 'Compaction preserves continuity.' Parsers accumulate over time. ## Problem We have multiple parsers for similar email types (e.g., DHL 'kommt heute' with slightly different fingerprints from pre-normalization era). They waste space and might have inconsistent quality. ## Proposal - Script: find parsers with same sender_domain and overlapping keywords - Compare their field_maps — if identical or near-identical, merge (keep higher use_count) - Run periodically or add to admin UI ## WSJF: 2 (Low value, Low urgency)