Accomplished data engineer with expertise in SQL, ETL/ELT processes, and Azure technologies, including Azure Data Factory and Synapse. Proficient in Databricks, Python, and PySpark for advanced data modelling and pipeline creation. Demonstrates strong skills in BI & Reporting using Power BI and Tableau to deliver insightful KPI reporting and ad-hoc analysis. Adept at stakeholder management, requirements gathering, and end-to-end delivery of data pipelines under tight deadlines. Committed to translating complex requirements into robust datasets while maintaining a strong operational focus on monitoring and proactive issue resolution. Collaborates effectively with external organisations to integrate data feeds seamlessly.
Overview
14
14
years of professional experience
2014
2014
years of post-secondary education
Work history
Senior Data Engineer
Midlands and Lancashire Commissioning Support Unit (MLCSU)
, UK
2022.08 - 2026.03
Senior Data Engineer at MLCSU designing and delivering high-performance data systems for healthcare analytics and administration. I build and optimise Azure Data Factory pipelines and multi-table datasets across environments, and develop scalable transformations using Python and PySpark (Databricks). I also collaborate with external organisations to architect and implement integrated data processing pipelines with a focus on reliability, performance, and governed data delivery.
Responsibilities / Contributions
Design, build and support ADF orchestration for multi-table datasets across dev/test/prod environments, ensuring consistent delivery and operational stability.
Build curated datasets using ADLS Gen2, Synapse and Azure SQL, aligning data structures and access patterns to reporting and analytics needs.
Develop scalable transformation logic in Databricks (Python/PySpark) using object-oriented patterns to improve reusability and maintainability.
Implement secure configuration management using Key Vault (e.g., secrets/connection strings) and support controlled access to sensitive healthcare data.
Use Azure Monitor / Log Analytics to support monitoring, troubleshooting and incident response for data pipelines and scheduled workloads.
Collaborate with external organisations to integrate data feeds and implement end-to-end processing pipelines, ensuring alignment on definitions, quality and delivery schedules.
Support delivery workflows using Azure DevOps, contributing to structured release practices and team visibility (boards, repos and/or pipelines).
Developed, maintained and automated complex Business Intelligence and reporting systems using Tableau, Power BI and Microsoft SQL Server tools.
Provided technical management of critical datasets and reports used for analysis and performance reporting.
Proactively resolved issues and supported development work, acting as a technical escalation point.
Managed stakeholder support through the team inbox: dashboard maintenance, issue triage, and responding to client queries.
Tech: Tableau, Power BI, SQL Server
Data Management Developer
NHS
2013.07 - 2017.12
Built regular and ad-hoc SSRS reports for consultants; modified and maintained data tables supporting routine reporting.
Validated, processed and produced datasets in SQL Reporting Services and SQL Server; managed corporate data items and structures.
Produced regular quality reports and supported development/maintenance of speciality-level quality indicators.
Monitored reporting and data-processing systems, escalating risks/issues to senior colleagues.
Investigated and resolved data issues to improve dataset accuracy and reliability.
Tech: SQL Server, SSRS
Information Analyst
NHS
2012.11 - 2013.06
Led information and analytical support to clinical directorates by working closely with clinicians and managers to identify complex information requirements and develop reporting solutions.
Monitored activity trends and produced reports to inform managers on current performance against targets.
Maintained a broad portfolio of routine and ad-hoc reporting for internal and external stakeholders.
Information Analyst
NHS
2012.04 - 2012.10
Gathered data from multiple sources, compiled into prescribed formats and produced analysed outcomes aligned to objectives.
Evaluated problems, investigated solutions using data analysis practices, and prepared analysis reports for stakeholders.
Maintained and updated databases and ensured safe storage of data.
Supported information services focusing on regular reporting of complex datasets for clinical quality indicators to deadlines.
Trainee Developer
NHS
2011.11 - 2012.04
Supported maintenance of existing reports and tables in SSRS and SQL Server.
Developed understanding of patient flow and care pathways within the trust to support accurate reporting and analysis.
Education
MSc - Internet Software Systems
University of Birmingham
Birmingham
Bachelor of Engineering - Computer Science
Avinashilingam University for Engineering
India
2006.01 - 2010.01
Skills
Data Engineering: SQL (T-SQL), ETL/ELT, SSIS, data modelling, automation/scheduling, performance tuning, data validation
Databricks: Python, PySpark, notebooks, jobs/workflows, object-oriented modelling, [Delta Lake / Unity Catalog if applicable]
BI & Reporting: Power BI, Tableau, SSRS, KPI reporting, ad-hoc analysis
Delivery: Stakeholder management, requirements gathering, BAU support/incident triage, documentation, teamwork
End-to-end delivery of data pipelines and reporting outputs under tight deadlines
Translating complex requirements into robust datasets, reusable transformations and reporting layers
Strong operational focus: monitoring, troubleshooting and proactive issue resolution
Collaboration with external organisations to integrate data feeds and deliver joined-up pipelines
ADDITIONAL INFORMATION
Top Skills: Teamwork
Python
Azure DevOps
Microsoft SQL Server
Analytical Skills
Professional Interests: Azure cloud data engineering, lakehouse patterns, strong governance for healthcare datasets, and AI integration with cloud services.
Timeline
Senior Data Engineer
Midlands and Lancashire Commissioning Support Unit (MLCSU)