Case Study - Survey Data Cleaning Toolkit

Client:
Public Sector Organisation
Date:
2025
The problem: Survey data preparation was being done manually; a slow, error-prone process that created a bottleneck before any analysis could begin. The underlying data was messy and complex, requiring de-duplication, validation, and reconciliation against external sources before it could be used.
What was done: A complete automated ETL and QA pipeline was designed and built from scratch, with usability as a core design principle. Excel/VBA utilities handled de-duplication and data cleaning; Web API integration backfilled missing data; and validation checks ran throughout. What had been a complicated process was rebuilt as something a non-technical client could run and understand themselves: a user-friendly interface backed by comprehensive documentation made handover straightforward, and the client took it on without issue.
The result: The client now manages their data preparation independently. A previously unwieldy manual process became a clean, structured workflow; accurate, repeatable, and fully self-sufficient. Final outputs feed directly into a linked Tableau dashboard.
