Data Contracts for Data Engineers: Stop Breaking Downstream Pipelines
Learn how data contracts prevent breaking changes, reduce pipeline incidents, and improve trust across producers and consumers with practical implementation patterns.
Clear, practical content about data engineering. The articles I wish existed when I started.
No articles match your search.
Learn how data contracts prevent breaking changes, reduce pipeline incidents, and improve trust across producers and consumers with practical implementation patterns.
How we solved YAML repetition in Databricks Asset Bundles (now Declarative Automation Bundles) by introducing Jinja2 templating as a pre-render step — keeping our DABs DRY, readable, and truly environment-aware.
How to apply software engineering and data engineering best practices in a Databricks project by separating orchestration from business logic and building maintainable PySpark pipelines.
Articles I'm currently working on
How my experience analyzing gravitational waves shaped my approach to data engineering and why the skills are more similar than you might think.
The story behind creating a salary and tax calculator for Italian workers, including technical challenges and user insights.
How principles from Bayesian inference and gravitational wave analysis apply to modern data engineering challenges.
Behind the scenes of analyzing the first-ever gravitational wave signal from a neutron star colliding with a black hole.
Follow me on LinkedIn to be notified when new articles are published.
Follow on LinkedIn