Accomplished Software Engineer versed in multiple programming languages and development frameworks. Partners successfully across teams to achieve project objectives. Analytical in approaching and resolving design problems.
Overview
18
18
years of professional experience
1
1
Certificate
Work history
Scala Developer
TSYSTEMS
Germany
Developed REST APIs using Scala , Play framework and Akka to store and retrieve data from MongoDB
I made use of libraries such as CATS , TAPIR and FS2
Used test frameworks like ScalaTest for writing test cases and coordinated with the QA team on end to end testing
Contribute to the development and continual enhancement of products
Used Scala fuctional programming concepts to develop business logic
Planning, estimation and design and usually done in a group
Developing features from little tweaks to many man-week roadmap items
This includes not only implementing the core functionality but also writing and executing unit and behavioral tests
Creating test plans and test scripts to be used by testers or business analysts
Technical requirements analysis & design, development and deployment
Creation and maintenance of automated tests (unit & QA)
Delivering high quality software at pace within a continuous delivery environment
An excellent ability to decompose complex problems into practical steps ., Deloitte
Build, deploy and operate outstanding digital services within an agile environment that meet well defined user needs
Deliver application designs that meet web standards, ensuring that key elements are built in from the outset
I used Scala/Play and integrated the CATS, TAPIR and ZIO libraries to enhance functional programming
Collaborate with Design Specialists to translate designs into high quality websites, apps, HTML emails, and interactive experiences
Contribute to the development and continual enhancement of products
Partner with Product Managers, Design Specialists, Business Analysts and Software Developers to facilitate a consistent user experience
Participate in the rapid development of user driven digital prototypes
Work in cross functional teams to write and test production quality, sustainable code for world-class user interfaces for new and existing systems
Ensure that new and updated digital services are thoroughly tested for accessibility and can be maintained and improved over the long term
Provide mentorship and/or line management for more junior Frontend Developers where necessary
Contribute to a culture of continual improvement in which key systems “owned” by the digital service team that are regularly analysed, maintained and improved
Contribute to a robust automated test suite to work in a continuous integration environment .
PDI Developer
HMRC
Manchester
Using PDI for Data Integration for ETL
Working within defined standards and job frameworks
Trouble shooting Pentaho Data Integrator server including platform
and Tools issues.
Business Intelligence Developer
NCP
London
Designing, building, testing, and maintaining data pipelines to connect operational systems, data for analytics and BI systems
This enabled the firm to generate insights into their data in real time
Using Azure Data Factory, Cosmos DB, Azure DevOps and Power BI
Designed, maintained and optimised Data Warehouse and ELT/ETL pipeline solutions to maximise performance using Pentaho Data Integration (Kettle and Spoon)
Designing and maintaining on-premises, transactional and analytical, MS SQL Server Infrastructure
Designing and developing data warehouse solutions
Developed Azure Function Apps in C# that consumed REST API's among other function.
Scala Developer
HMRC
06.2019 - 04.2020
Developed advanced applications using Scala/Play, integrating the CATS and ZIO librarIes for enhanced functional programming capabilities
Employed AKKA streams for asynchronous data flow and event-driven solutions, improving system responsiveness and user experience
Designed and managed robust Microservices, focusing on data consistency and fault tolerance, with MongoDB integration for efficient data management
Worked closely with teams to set best practices in agile methodologies, including test-driven development (TDD) and paired programming
Led and participated in group sessions for planning, estimation, and design
Regularly integrated and enhanced core functionalities, ranging from minor tweaks to significant, multi-week roadmap items
Emphasized comprehensive testing by creating automated tests and collaborating with the QA team for end-to-end test scenarios using tools like ScalaTest
Advocated for technical best practices and provided mentorship, utilizing methods such as pair programming to uplift less experienced team members
Ensured rapid, quality software delivery within a continuous delivery environment, leveraging my expertise in decomposing complex problems for practical execution.
Data Engineer
WEJO
Chester
07.2018 - 05.2019
Engineering and modelling data pipeline platforms for scale, performance, reliability and security
Work with other members of Data Engineering team to design and build significant data streaming capabilities using AWS data pipeline, S3, SQS, SNS, EMR and Lambda as well as leveraging technologies like scala, spark, pulsar and Kafka
Work with product owners and business analysts in analysing business requirements to design and implement data processing pipelines, associated data and database structures and fine-tune performance to meet those requirements
Review new external data sets and open data sources to understand potential usage
Work with Infrastructure and DevOps teams to release and maintain live products
Processing large datasets using Scala/Spark running as Transient Cluster using AWS EMR
Used a Mongo Management Service for automating a variety of tasks, including backup/recovery and performance management
Design, Implement & Test all data processing systems
Participate in establishing processes and best practices around development standards, version control, quality control, deployment, maintenance and change management.
Scala Developer
Shop Direct Group
Liverpool
01.2018 - 06.2018
Spark / Scala coding, unit testing, system testing
Involved in design and building infrastructure and application for API using AWS ALB, EC2, Cassandra, Scala (Akka Framework)
Jenkins deployment using BLUE/GREEN deployment
Involved Kafka cluster using PUPPET and CloudFormation
Involved in building streaming jobs using Kafka Streams, Number of source and sink connectors used in clusters
Agile Backlog Grooming
Used docker to deploying Python packages as AWS Lambda Layers
Definition of Acceptance Criteria for QA and Business Analysts
Writing technical design documentation (high and low level) as required
Liaising with QA team to ensure that documentation is fit for purpose
Working with system team to perform load, performance and destructive testing
Modeling and developing data and CI/CD pipelines for production and pre-production environments Using primarily AWS such as S3, SQS, SNS, EMR and Lambda leveraging Kafka, and Cassandra
Used the Play Framework to update logic used to transform data received in a json into Cassandra , Oracle RDS and S3 based on respective criteria.
Architect / Analyst Developer
Cap Gemini HMRC
12.2014 - 05.2017
EDH Project, Lonon - Telford
Designed and developed web applications using Django, which used parsed SOLR queries based on chosen parameters at runtime
This application was predicted to save the HMRC £6M in tax revenue annually from inappropriate tax submissions
Used Sqoop and Flume to move data through various landing stages in Hadoop ecosystem once data had been through the cleansing process using shell scripts before placing Hive tables over them where required
Developed MapReduce programs in Java to parse raw data and also used Morphlines to perform ETL operations on data before indexing them for SOLR
Used Pentaho PDI and Informatica to transform data
Used Spark and Scala for program development using TDD methods and data analysis
Used AWS for proof of concept development and deployments that required data modelling and analytics.
Lead Application Architect/Developer
Williams Grand Prix Engineering IT
Oxford
03.2002 - 12.2014
Modelled and developed highly-scalable and performant pipelines that store and process large amounts of data in a distributed system
Developed Scala programs using TDD methods
Used AWS in development and proof of concept programs
Shared responsibility for the administration of Hadoop
Created Hive queries that helped with the comparison of car data models and historical metrics
Developed MapReduce programs to parse raw data, populate staging tables and store refined data in Hive tables
Produce high and low-level designs for numerous multi-threaded applications such as desktop, web and mobile utilising frameworks such as TOGAF, UML, OOD and Agile
Development of multiple applications utilising technologies such as C#, C++, J2EE, WPF, Windows Form, Visual Studio, Dev Express, Dundas and SOA
Translate business requirements into functional specification highlighting interactions between system interfaces and application functionalities
Technical design authority ensuring that systems are developed following policies and standards whilst promoting useability of components
Liaison with stakeholders including C-level to elicit, analyse, communicate and validate requirements for changes to business processes, policies and information systems
Co-ordinate and contribute to RFP, RFQ and vendor selection processes
Translate business requirements into a business process and system processes using BPM
Led various system integrations and report authoring projects utilising technologies XSDs/WSDL, Oracle, Crystal, Cognos, PERL, C-Sharp and MS SharePoint
Manage logical design and physical implementation of databases and data-warehouses using Microsoft and Oracle technologies
Ensure that functional and non-functional requirements are analysed, captured, prioritised and validated
Design and develop data extraction, transformation and load strategy from disparate sources into centralised data warehouse using Oracle and Microsoft BI technologies
Remove bottlenecks in business processes through transformation and managed upgrade and consolidation of IT infrastructures
Manage end-to-end system testing including analysis of specifications, reviewing documentation, internal /client liaison, regression testing and OAT
Built programs that used large datasets and leveraged the Hadoop ecosystem using MongoDB, where MongoDB was used as a real-time data store and Hadoop was used for batch data processing and analysis
Involved in designing and improving component tracking system
I had a major role in the architectural design and development of a system that was used to store, track, and analyse component usage with integrations into a Chrous Financial and a Siemens PLM system saving the firm over £300,000.00 in aquiring MRP licenses .
Education
Master of Business Administration - Data Analytics
Cranfield University
Advanced Diploma - Computing
Oxford University
B.Tech - Business Studies
Greenwich University
Skills
Hadoop - Cloudera and HortornWorks
Spark
Hive and Impala
AWS Kenisis Streams
Kafka
Scala
HBase
Cassandra
Java
Oracle
SQL Server
Python
AWS
AZURE
Jenkins
Microsoft Visual C#NET
Additional Information
.
.
Timeline
Scala Developer
HMRC
06.2019 - 04.2020
Data Engineer
WEJO
07.2018 - 05.2019
Scala Developer
Shop Direct Group
01.2018 - 06.2018
Architect / Analyst Developer
Cap Gemini HMRC
12.2014 - 05.2017
Lead Application Architect/Developer
Williams Grand Prix Engineering IT
03.2002 - 12.2014
Scala Developer
TSYSTEMS
PDI Developer
HMRC
Business Intelligence Developer
NCP
Master of Business Administration - Data Analytics