Summary
Overview
Work history
Education
Skills
ABOUT ME
Timeline
Generic

Adam Leigh

Aylesbury,Buckinghamshire

Summary

Highly skilled data engineer of 6 years with expertise in SQL, Python and AWS solution development. During my time with both LLI and Nationwide I have been responsible for developing and maintaining extensive end-to-end cloud data pipelines with thousands of end users daily.

I've been fortunate enough to gain a wealth of experience on both large scale batch processing as well as real-time data streaming projects, both of which have given me a fantastic breadth of knowledge in development tools and progressive ideas on to how to tackle complex system and data related problems.

I've enjoyed managing the migration of pipeline stages from outdated legacy systems to fully automated and monitored cloud native solutions deployed and managed by Terraform codebases.

I'm an extremely passionate learner and thrive in collaborative, free-thinking environments where I can use the experience I've gained and learn from other professionals to produce succinct and efficient data solutions.

Overview

4
4
years of professional experience
2019
2019
years of post-secondary education

Work history

Data Engineer

Lloyds List Intelligence
London
06.2023 - Current

During my time at Lloyds List I've been acting as the principal engineer managing our the two flagship data products responsible for millions of pounds of turnover annually. Some of my notable responsibilities are as follows:

  • Maintained and contributed to development of real-time streaming projects using Kinesis and SAS ESP ensuring minimal downtime and efficient processing of millions of data points daily.
  • Maintained and contributed to development of large scale batch processing pipelines using SAS Viya and AWS resources (Redshift, S3, SageMaker and Glue).
  • Migrated and modernised chunks of large scale data pipelines from SAS to AWS native utilities including Glue and Lambda deployed via Terraform.
  • Managed workflows through various orchestration tools such as GitHub Actions, Jenkins and Apache Airflow.

Data Engineer - E2

Nationwide
Swindon, Wiltshire
08.2021 - 05.2023
  • Contributing to the development and automation of and end-to-end AWS based pipeline which is currently live to over 10,000 daily users via a bespoke API.
  • Creating a complete, learning categorisation algorithm for transactions
  • Collating on-premise data from a variety of sources with Python and Shell and pushing data to S3, automated using Apache Airflow
  • Producing a robust end-to-end AWS ETL solution using S3, RDS, DynamoDB, Glue, Lambdas and an API for accessibility
  • Monitoring solutions via Elastic Search and Kibana and creating meaningful dashboards for key stakeholders

Education

Bachelor of Science - Mathematics

University of Southampton

Skills

  • Python
  • SQL: SQL Server and Teradata
  • NoSQL: MongoDB
  • Orchestration: Apache Airflow, Jenkins, GitHub Actions, Bespoke Tooling
  • Source Control: GitHub, TFS
  • AWS: S3, RDS, DynamoDB, Glue, Lambdas, API, Athena, Redshift, Kinesis, SageMaker
  • IaC: Terraform
  • Monitoring: Elastic/OpenSearch, Kibana, CloudWatch
  • Visualisation: Tableau, Power BI
  • Others: SAS (Viya and ESP), Shell, Latex, Java

ABOUT ME

Aside from work, I'm a fitness enthusiast, having been an avid runner and triathlete in my time at university (completing multiple 5k, 10k, duathlon and even a half marathon events on behalf of the university) I have recently found myself more interested in lifting weights in the gym and go daily.

To balance out my interests in fitness I also compete semi-professionally in videogaming, having won a few tournaments in games such as Dota 2, Call of Duty and Runescape I've always been an avid fan of games.

These hobbies have been massive pointers in the direction of pursuing a career in data as I regularly track my workouts and nutrition as well as scores on various games as somewhat of a healthy competition with my brothers.

Timeline

Data Engineer

Lloyds List Intelligence
06.2023 - Current

Data Engineer - E2

Nationwide
08.2021 - 05.2023

Bachelor of Science - Mathematics

University of Southampton
Adam Leigh