project
Telemetry transformation layer
Refactored event-processing pipelines into a governed, queryable transformation layer for trusted operational analytics.
tag
#delta-lake
3 items · 1 project · 2 feed items
projects
feed
post
Medallion architecture: the rules I now follow for bronze, silver, gold
After three years of building and refactoring medallion data lakes, here's the opinionated rule set that holds up: what bronze should and should not do, what makes silver actually queryable, and how to keep gold from drifting into chaos.
post
Delta Lake MERGE patterns I wish I'd learned a year earlier
Five MERGE patterns that solved real problems for me: idempotent upsert, soft delete, late-arriving data, deduplication on ingest, and the slowly-changing-dimension type-2 case. Plus the performance gotchas that bit me first.