Katy Angus
Summary
I’m a data engineer with strong experience building low-latency streaming solutions and working across Azure data platforms. I’ve spent a lot of time using Python, SQL, and PySpark to build reliable pipelines, improve data quality, and put solid governance in place. I’m comfortable pulling together data from different sources, tuning performance in distributed environments, and using Terraform and CI/CD to deliver scalable solutions cleanly and consistently. I work well with both technical teams and stakeholders, and I stay calm and practical when production issues need resolving. Overall, I bring a hands-on, delivery-focused approach to data engineering and enjoy helping teams build better, more reliable data platforms.
Overview
4
4
years of professional experience
4
4
years of post-secondary education
Work history
Data Engineer
Kubrick / Aubay at Shell
London
2022.05 - Current
Data Engineer experienced in building enterprise-scale data platforms for renewable power operations, with strong delivery across real-time ingestion, distributed transformation, and production reliability in multi-vendor environments.
Technologies & Platforms
- Python, SQL, PySpark (plus working Scala knowledge)
- Databricks, Apache Spark, Delta Lake
- Kafka, Azure Event Hubs, ADLS, Azure SQL
- Azure services: Key Vault, Monitor/Application Insights, managed identity/service principals
- Terraform, YAML, PowerShell/Shell scripting
- GitHub Actions, Azure Pipelines, SonarQube, Python packaging (wheels/setuptools)
- Area of growth focus is to learn .Net programming language, allowing further understanding of downstream processes
Data Engineering Focus
- Low-latency streaming pipeline design and optimization for near real-time data processing
- End-to-end ETL/ELT across real-time and batch workloads
- Multi-source/vendor integration with standardized schemas (JSON/CSV/API/SFTP)
- Data modeling, reference data management, and governance
- Data quality, lineage, and traceability (audit fields, validation, source tracking)
- Distributed/stateful processing tuning (checkpointing, partitioning, compression, performance optimization)
- Production observability through logging, tracing, and operational monitoring
Delivery Model & Ways of Working
- Reusable, modular, configuration-driven data components
- Multi-environment delivery lifecycle (dev, test, UAT/QAT, prod)
- Agile/Kanban execution including sprint planning and delivery ownership
- Full ownership from requirements to release and continuous improvement
Domain, Leadership & Stakeholder Impact
- Worked as a data engineer within Power trading for 3 and a half years, resulting in varied knowledge of wind, solar and battery data across the business
- Strong stakeholder management across engineers, architects, and business teams
- Leadership through mentoring, standards adoption, and cross-functional coordination
- Calm, structured response in high-pressure production and incident scenarios
Accounts payable clerk
Clockwork Removal Ltd.
2021.10 - 2022.04
- Managed purchase invoices, supplier statement reconciliations, and supplier payments.
- Assisted in accounting for inter-company and capital expenditure within purchase ledger.
- Supported payroll and bank reconciliation tasks.
- Engaged with customers, suppliers, stakeholders, and employees across UK, developing communication skills.
Education
Bachelor of Science - Mathematics
University of Glasgow
2017.09 - 2021.06
Skills
- Low-Latency Streaming Engineering
- Python, SQL & PySpark Delivery
- Azure Data Platform Engineering
- Data Quality and Governance
- Multi-Source Data Integration
- Distributed Performance Optimization
- Terraform and CI/CD Automation
- Stakeholder and Technical Leadership
- Calm Production Incident Response
Timeline
Data Engineer
Kubrick / Aubay at Shell
2022.05 - Current
Accounts payable clerk
Clockwork Removal Ltd.
2021.10 - 2022.04
Bachelor of Science - Mathematics
University of Glasgow
2017.09 - 2021.06