Highly skilled Data Engineer with 5+ years of experience designing and implementing advanced data solutions to enhance business decision-making. Proficient in Azure Data Factory, Azure Databricks, PySpark, Python, and Snowflake. Adept at transforming complex datasets into actionable insights, driving efficiency, and aligning technical solutions with strategic objectives. Demonstrated expertise in ETL processes, data security, and reporting for UK-based organizations, including Close Brothers Group and Janus Henderson Investors.
Overview
2
2
years of professional experience
Work History
Technology Analyst
Infosys Limited
Hyderabad
03.2022 - 11.2023
Developed and maintained a Snowflake Data Warehouse for a leading UK finance company, optimizing ETL workflows and improving data usability.
Implemented Control-M scheduling for production environments, reducing manual errors by 30%.
Designed and implemented Snowflake objects, including views and tables, customized to meet specific business requirements.
Collaborated with QA teams for non-functional testing, and provided comprehensive support for user acceptance testing (UAT).
Effectively resolved defects and worked on system stabilization, contributing to overall performance optimization.
Gained valuable experience working with UK-based companies including Close Brothers Group and Janus Henderson Investors.
Data Engineer
Close Brothers Group, UK
12.2022 - 11.2023
Experienced in developing Snowflake Data Warehouse and ETL for Close Brothers Group Finance Company in an Agile-based lifecycle.
Understanding the business requirements and studying the existing system design for its impact of change.
Developed ETL workflows and Snowflake objects, such as views and tables, as per the business requirements and for the data flows in the data warehouse.
I worked on Control M scheduling according to the production scenario. Provided extensive support for User Acceptance Testing and fixing bugs in a timely manner.
Collaborated with support and QA engineers for non-functional testing in pre-production and dress rehearsal testing.
Developed Python scripts for extracting data from web services API's and loading into databases.
Optimized SQL queries and database schemas for performance improvements in data retrieval operations.
Participated in agile development processes, contributing to sprint planning, stand-ups, and reviews to ensure timely delivery of data projects.
Configured and maintained cloud-based data infrastructure on platforms like AWS, Azure, and Google Cloud to enhance data storage and computation capabilities.
Informatica Developer
Janus Henderson Investors, UK
04.2022 - 12.2022
Identified, debugged, and resolved system bottlenecks and technical issues, ensuring optimal performance and efficiency.
Designed and developed mappings, mapplets, sessions, and workflows to efficiently load data from source systems to staging areas, and subsequently to target systems.
Created reusable transformation components, including Lookup, Aggregator, Joiner, and Filter transformations, to address complex business requirements, and streamline data processing workflows.
Conducted thorough unit testing on developed components, providing comprehensive test evidence to ensure the integrity and accuracy of data processing tasks.
Actively participated in daily status calls with clients, providing regular updates on project progress, identifying issues, and aligning deliverables with client expectations.
Worked on intricate mappings, managing an average of 15 transformations, to ensure accurate and efficient data integration across systems.
Utilized Autosys to automate job scheduling, optimizing the workflow, and ensuring timely execution of data processes.
Managed code deployment to higher environments through deployment groups, ensuring smooth transitions, and minimal disruption to production systems.
Provided crucial support during migration activities, troubleshooting, and resolving production issues to maintain system integrity and minimize downtime.