Ravulapalli

Summary

Results-driven Data Engineer with 10+ years of experience designing, developing, and optimizing ETL pipelines and data warehouse solutions across on-premise and cloud platforms. Expertise in SQL Server, SSIS, Azure Data Factory, Azure Synapse Analytics, AWS, and Microsoft Fabric. Proven track record in multi-source data integration, performance optimization, and delivering reliable data solutions for analytics and business intelligence.

Overview

years of professional experience

Work history

Senior Data Engineer

DWP

2024.11 - 2026.04

Developed and orchestrated data pipelines using Microsoft Fabric Data Pipelines for ingestion and transformation.
Worked on Microsoft Fabric Lakehouse architecture for managing and analysing data.
Fetched and integrated data from multiple sources, including SQL databases, SharePoint, REST APIs, and cloud storage into the Lakehouse.
Performed data transformation, cleansing, and enrichment within Fabric.
Debugged pipeline failures and implemented monitoring and alerts.
Designed and optimised data models for reporting and analytics.
Tuned SQL queries for performance optimisation within the Lakehouse.
Automated workflows and notifications using Power Automate.
Implemented governance, security, and access control mechanisms.
Improved pipeline efficiency and ensured data reliability across systems.
Designed complex SQL queries, improving database efficiency.
Collected and analysed data, providing recommendations to help improve database performance.
Resolved performance issues quickly through accurate root cause identification.

AWS Data Engineer

NHS

2023.07 - 2024.10

Developed ETL pipelines using AWS Glue for processing large datasets.
Fetched and integrated data from multiple sources including SQL Server, APIs, flat files, and cloud storage into S3.
Performed data transformation and enrichment using PySpark in Glue.
Loaded processed data into Amazon Redshift for analytics.
Debugged Glue jobs and implemented data validation checks.
Optimized Redshift performance using distribution styles, sort keys, and vacuum operations.
Implemented partitioning strategies in S3 to improve query efficiency.
Monitored pipelines using CloudWatch and set up alerts.
Ensured security and compliance using IAM roles, encryption, and policies.

Azure Data Engineer

Sainsburys

2021.01 - 2023.06

Designed and implemented pipelines in Azure Data Factory for fetching and integrating data from multiple sources including SQL databases, SharePoint, REST APIs (HTTP), Azure Cosmos DB, and Google Analytics.
Migrated legacy SSIS packages to ADF pipelines.
Used Mapping Data Flows for data transformation and enrichment.
Loaded and transformed data into Azure Synapse Analytics for reporting and analytics.
Debugged pipeline failures and implemented retry mechanisms and alerts.
Optimized data loads using partitioning, indexing, and parallel execution.
Implemented triggers, scheduling, and monitoring for pipelines.
Ensured secure data access using RBAC and managed identities.

BI Developer

Bank of America

2016.04 - 2020.12

Built advanced SSIS packages integrating data from APIs, Excel, SharePoint, and relational databases.
Implemented Slowly Changing Dimensions (SCD Type 1 & 2) for historical data management.
Debugged and resolved production ETL failures.
Optimized ETL workflows using parallel processing and efficient transformations.
Tuned SQL queries and implemented partitioning for better performance.
Developed reusable ETL components for faster deployment.
Managed data modelling and warehousing solutions according to business aims.
Analysed complex data sets to enhance business performance.

Software Engineer

Aditya Birla

2015.01 - 2016.03

Developed ETL pipelines using SSIS to extract, transform, and load data from multiple sources including SQL Server, flat files, and Excel.
Wrote complex SQL queries, joins, and stored procedures for data processing and reporting.
Debugged SSIS packages to resolve data flow and control flow issues.
Implemented error handling, logging, and event handling frameworks.
Performed data cleansing, null handling, and deduplication.
Optimized SQL queries using indexing and execution plan analysis.
Scheduled and monitored ETL jobs using SQL Server Agent.
Maintained documentation for ETL workflows and data mappings.
Reviewed, validated and automated testing to improve code quality.

Education

Master of Computer Applications -

Osmania University

India

Skills

Languages: SQL, Python
ETL Tools: SSIS, Azure Data Factory, Microsoft Fabric Data Pipelines
Cloud Platforms: Azure, AWS, Microsoft Fabric
Data Warehousing: Azure Synapse Analytics, Amazon Redshift

Databases: SQL Server, Azure Cosmos DB
AWS Services: S3, Glue, Redshift, CloudWatch
Automation: Power Automate
Concepts: Data Modeling, ETL Design, Data Governance, Performance Tuning, Data Integration

Timeline