Data engineering
Data Platform Modernization
Moved a company's reporting off an ageing system onto a modern data platform, so reports run faster and cost less.
- BeforeSlow, ageing reportsReports many teams relied on ran on old, hard-to-change code.
- What I didMoved and rebuiltThe logic was rewritten for a modern platform, one checked step at a time.
- AfterFaster, cheaper answersQuicker reports on a platform that is easier to grow.
Reporting that many teams relied on ran on old SQL that was slow and hard to change. I led its move to Databricks and rewrote the logic as clean, testable code, so reports come back faster and the platform costs less to run.
Full migration
Analytics workloads moved off Azure Synapse, one validated step at a time.
Logic rebuilt, not lifted
Legacy SQL became readable, testable PySpark notebooks.
Faster and cheaper
Quicker queries and lower compute, on a platform that is easier to extend.
Built with
- Databricks
- PySpark
- Delta Lake
- Azure