Summary
Overview
Work History
Education
Skills
Certification
Timeline
Generic

KAILASH BALACHANDIRAN

Newcastle upon Tyne (Willing to Relocate), United Kingdom

Summary

Results-driven Data Engineer with 4 years of experience specializing in the development, optimization, and deployment of data solutions using Databricks, ADF, SQL, PySpark, and Delta Lake. Experienced in working with stakeholders to gather and analyze business requirements, leveraging a wide array of tools such as Power BI, Synapse, and Dataverse to deliver robust ETL pipelines and data processing solutions. Expertise includes improving data performance, optimizing big data workflows, and ensuring data governance through effective implementation of RBAC and IAM.

Overview

5
5
years of professional experience
1
1
Certification

Work History

Azure Data Engineer

Fiverr
Remote
09.2023 - Current
  • Actively collaborated with stakeholders to gather business requirements and delivered solutions that improved project delivery timelines by 40%.
  • Implemented data solutions using Databricks, Fabric, Unity Catalog, Synapse, PySpark, and Python, reducing data processing time by 30% and enhancing scalability.
  • Optimized big data ETL pipelines with PySpark, reducing job execution time by 40% and increasing transformation efficiency.
  • Automated testing and deployment processes using Python, increasing testing coverage by 50% and accelerating delivery of high-quality solutions.
  • Designed metadata-driven pipelines using Delta Lake, Azure Purview, ADLS, and Python within Databricks and ADF, reducing data errors by 30%.
  • Built interactive Power BI dashboards to deliver real-time insights, leading to 20% increase in user engagement and report usage.
  • Developed and maintained Data Lakes and Warehouses with Delta Lake and Azure Synapse, reducing storage costs by 20% and improving query performance.
  • Enforced data governance through RBAC and IAM, reducing unauthorized access by 35% and ensuring compliance with security policies.
  • Optimized SQL queries and PySpark scripts, improving processing efficiency and reducing runtime by 25%.
  • Utilized Azure DevOps to automate deployment processes, cutting deployment time by 30% and minimizing production errors.
  • Integrated data from CRM and Dataverse into Azure SQL DB via ADF, reducing synchronization time by 20% and improving data accuracy.
  • Delivered Power BI dashboards that enhanced real-time decision-making, leading to 25% increase in data-driven actions by senior leadership.

Data Network Engineer

Huawei Technologies
Bengaluru, India
08.2021 - 08.2022
  • Collaborated with business teams to gather data requirements and build scalable solutions, improving project alignment and reducing delivery time by 25%.
  • Designed and maintained ETL pipelines using Azure Data Factory, Databricks, and PySpark, cutting data processing time by 40%.
  • Built reusable, metadata-driven pipelines to ensure consistency across workflows and simplify ongoing development.
  • Automated data validation and testing using Python, reducing manual QA efforts by over 50% and increasing data reliability.
  • Integrated Azure Synapse with ADLS Gen2 for real-time reporting, improving analytics performance and accessibility.
  • Implemented Unity Catalog and Azure Purview for metadata management and lineage tracking, improving data governance and audit readiness.
  • Developed and maintained Power BI dashboards connected to Azure SQL and Delta Lake, enabling better insights and increasing user adoption by 20%.
  • Rebuilt legacy pipelines with modular design, reducing maintenance time by 40% and improving scalability.
  • Enforced RBAC and IAM policies across the platform, enhancing data security and reducing unauthorized access.
  • Enabled real-time CRM data sync between Dataverse and Azure SQL using ADF, improving reporting accuracy and data availability.
  • Automated CI/CD pipelines using Azure DevOps, cutting deployment times and improving release reliability.
  • Tuned SQL and PySpark scripts to optimize performance on large datasets, reducing refresh times by 35%.

Data Network Engineer

STC Kuwait
Bengaluru, India
08.2020 - 07.2021
  • Built automated ETL workflows using Azure Data Factory (ADF) to extract, transform, and load data from on-premise SQL databases to Azure Data Lake Storage (ADLS), improving data accessibility and reliability.
  • Migrated legacy SSIS-based ETL packages to ADF pipelines, reducing runtime by 30% and enhancing scalability in the cloud.
  • Integrated Azure SQL Database with Power BI for real-time dashboards and reporting, enabling faster decision-making across teams.
  • Created and maintained data models and schemas to support efficient data retrieval for downstream analytics and reporting tools.
  • Implemented data validation and cleansing processes using SQL and ADF data flows, increasing accuracy and trust in reports.
  • Designed daily and weekly scheduled jobs using SQL Server Agent to automate data refresh and backup operations.
  • Collaborated with cross-functional teams to gather business requirements and translate them into scalable data solutions.
  • Followed best practices in security and governance by applying RBAC and encrypting data in transit and at rest within the Azure environment.
  • Documented ETL workflows, data dictionaries, and pipeline dependencies to support knowledge sharing and operational continuity.

Data Engineer Intern

NLC India Limited
Neyveli, India
01.2020 - 07.2020
  • Developed and maintained complex T-SQL queries, stored procedures, and views in Microsoft SQL Server 2017, supporting daily reporting and analytics for sales and operations teams.
  • Created and optimized scheduled SQL Server Agent jobs to automate ETL processes, reducing manual data refresh efforts by 40%.
  • Built interactive Power BI dashboards for key stakeholders, visualizing performance metrics, financial data, and operational KPIs, leading to faster and more data-informed decision-making.
  • Integrated Power BI Service for publishing and sharing reports across departments, enabling self-service analytics and improving user adoption by 30%.
  • Utilized Azure Data Factory (ADF) to orchestrate data movement and transformation workflows from on-prem SQL Server to Azure Data Lake Storage (ADLS), improving data accessibility in the cloud.
  • Implemented role-level security (RLS) in Power BI and RBAC on Azure resources to enforce controlled access to sensitive data, supporting compliance and governance standards.
  • Leveraged Azure Blob Storage and Azure SQL Database to offload historical data from on-prem systems, improving performance of transactional systems by 20%.
  • Participated in the early design of a cloud migration strategy, working with data architects to evaluate Azure components such as Azure Logic Apps, Key Vault, and Azure Monitor for future integration.
  • Documented data models, Power BI dataset relationships, and data refresh schedules to ensure maintainability and knowledge sharing within the team.

Education

Master of Science - Advanced Computer Science

Newcastle University
Newcastle upon Tyne
09/2022 - 09/2023

Bachelor of Science - Electronics and Communication Engineering

Vellore Institute of Technology
Vellore, India
07/2016 - 06/2020

Skills

  • Data Engineering: ADF, Databricks, Fabric, Synapse Analytics, SSIS, SSAS, Delta Lake, ADLS
  • ETL & Data Pipelines: Design & Optimization, Batch & Real-Time Data Processing, Data Cleansing & Transformation
  • BI & Analytics: Power BI, Tableau, Azure SQL DB, RedShift, SAP BO, Data Warehousing
  • Languages & Tools: Python, PySpark, SQL, DevOps, Git, Airflow, Cosmos DB, Unity Catalog
  • Cloud Platforms: Microsoft Azure (Azure SQL DB, ADLS, ADF), AWS S3, RedShift, Dataverse
  • Data Integration & Storage: Data Lakehouse architecture, Delta Lake, SAP BW Integration

Certification

  • AWS Certified Solutions Architect – Associate

Amazon


  • Python Programming

Huawei Technologies


  • Data Analytics

Coursera


  • Microsoft Azure Data Engineer Associate (DP-203)

Microsoft

Timeline

Azure Data Engineer

Fiverr
09.2023 - Current

Data Network Engineer

Huawei Technologies
08.2021 - 08.2022

Data Network Engineer

STC Kuwait
08.2020 - 07.2021

Data Engineer Intern

NLC India Limited
01.2020 - 07.2020

Master of Science - Advanced Computer Science

Newcastle University
09/2022 - 09/2023

Bachelor of Science - Electronics and Communication Engineering

Vellore Institute of Technology
07/2016 - 06/2020

Similar Profiles

CREATE PROFILE
KAILASH BALACHANDIRAN