Summary
Overview
Work history
Education
Skills
Certification
Timeline
Generic

Prasad Veerapalli

Summary

  • Skilled Data Engineer with 4.5+ years of experience in designing, developing, and optimizing data pipelines and ETL workflows in Azure ecosystems.
  • Hands-on expertise in Azure Data Factory, Data Lake, Synapse, Databricks, and Microsoft Fabric for managing large-scale data ingestion, transformation, and modeling.
  • Advanced proficiency in T-SQL, Python, and PySpark for data wrangling, performance tuning, and business intelligence enablement.
  • Proficient in SQL Server, SSIS, and Power BI for full-cycle data engineering including reporting, performance tuning, data warehousing, and data migration to cloud.
  • Strong understanding of data modeling (Star Schema, OLAP/OLTP), RDBMS, and big data architecture with a focus on automation and scalability.

Overview

5
5
years of professional experience
5
5
years of post-secondary education
1
1
Certification

Work history

Senior data engineer

Liya technologies, Client: Homesite Insurance
London
01.2023 - Current
  • Designed and deployed scalable Azure Data Factory pipelines to ingest and transform data from SQL Server, APIs, and flat files into Azure Data Lake (OneLake).
  • Utilized Microsoft Fabric to streamline data ingestion via dataflows, lakehouses, and notebooks, optimizing unified data architecture across business units.
  • Utilized Azure Databricks and PySpark for scalable data processing, batch ingestion, and transformation tasks integrated with Azure Data Lake Storage and SQL-based destinations.
  • Led data migration projects from on-prem SQL Server to Azure SQL Database, handling schema conversion, performance optimization, and cloud integration.
  • Built robust data validation layers using Python and T-SQL to maintain data integrity across transformation steps.
  • Mounted Azure Storage in Databricks via service principals; managed secrets using Azure Key Vault to enhance data security.
  • Designed and deployed interactive Power BI dashboards built over Azure SQL and Fabric Lakehouses, implementing Row-Level Security (RLS).
  • Collaborated with cross-functional teams including analysts and architects to define data models and implement Dimensional Modeling (Star Schema) strategies.
  • Performed data profiling, quality checks, and implemented monitoring pipelines for automated alerts on anomalies or pipeline failures.

Data engineer

Foco IT consulting Ltd
India
09.2021 - 07.2022
  • Developed high-performance ETL processes using Azure Data Factory and SSIS, loading and transforming large datasets into cloud-based warehouses.
  • Created complex stored procedures, triggers, views, and indexes to improve query performance in high-volume transactional systems.
  • Managed performance tuning tasks using execution plans, partitioning, and indexing strategies for optimized query performance.
  • Engineered automated health checks for Azure SQL Database including CPU/memory monitoring, long-running queries, and disk I/O bottlenecks.
  • Migrated data workloads from on-prem to Azure Cloud using ADF with robust error handling, logging, and validation mechanisms.
  • Built metadata-driven frameworks for pipeline orchestration, improving reusability and reducing maintenance overhead.

Data analyst

Foco IT consulting Ltd
India
06.2020 - 08.2021
  • Engineered ETL pipelines using SSIS and T-SQL to ingest retail and supply chain data from distributed systems into centralized data marts.
  • Implemented normalized and denormalized schemas for OLTP and OLAP systems, ensuring compatibility with Power BI and SSRS reporting requirements.
  • Conducted root cause analysis on data quality issues, applying fixes in upstream pipelines and enhancing data governance practices.
  • Designed data audit and alerting frameworks to notify key stakeholders of failures, data anomalies, or SLA breaches in nightly batch jobs.
  • Collaborated with BI teams to deliver actionable insights via SSRS and Power BI dashboards, enabling business users to drive strategic decisions.

Education

Master of Science - Data Science

University of Exeter
Exeter
09.2022 - 06.2023

Bachelor of Science - Computer Science

Reva University
India
06.2016 - 05.2020

Skills

    TECHNICAL SKILLS

    Cloud & Data Platforms:
    Azure Data Factory, Azure Synapse, Azure Data Lake Storage, Azure SQL Database, Azure Databricks, Azure Blob Storage, Microsoft Fabric, OneLake


    ETL & Data Integration:
    Azure Data Factory (ADF), SSIS, Dataflows (Microsoft Fabric), CI/CD Pipelines, Azure DevOps, Fabric Data Factory


    Programming Languages:
    SQL, T-SQL, Python, PySpark


    Database Technologies:
    MS SQL Server, Azure SQL, PostgreSQL, MySQL


    Big Data & Processing:
    Azure Databricks, Spark (via PySpark), Delta Lake


    Reporting & BI Tools:
    Power BI, SQL Server Reporting Services (SSRS), DAX, Row-Level Security (RLS)


    Data Modeling & Warehousing:
    Star Schema, Snowflake Schema, OLAP/OLTP, Normalization/Denormalization, Dimensional Modeling


    Monitoring & Security:
    Azure Monitor, Log Analytics, Azure Key Vault, Data Quality Checks, Alerts & Triggers


    Tools & Utilities:
    Visual Studio, SQL Server Management Studio (SSMS), Azure Storage Explorer, Git, Microsoft Excel, PowerPoint

Certification

  • Microsoft Certified: Azure Data Engineer Associate
  • Microsoft Certified: Azure Data Fundamentals
  • Microsoft Certified: Power BI Data Analyst Associate

Timeline

Senior data engineer

Liya technologies, Client: Homesite Insurance
01.2023 - Current

Master of Science - Data Science

University of Exeter
09.2022 - 06.2023

Data engineer

Foco IT consulting Ltd
09.2021 - 07.2022

Data analyst

Foco IT consulting Ltd
06.2020 - 08.2021

Bachelor of Science - Computer Science

Reva University
06.2016 - 05.2020

Similar Profiles

Create profile
Prasad Veerapalli