Summary
Overview
Work History
Education
Skills
Languages
Timeline
Generic

Diksha Joshi

Reading,Berkshire

Summary

Results-driven Data Engineer with a strong foundation in SQL and Python, seeking opportunities to design and optimize scalable data pipelines. Experienced in developing ETL workflows, data ingestion, transformation, and validation. Skilled in real-time and batch data streaming, with expertise in processing marketing and CRM data. Proficient in cloud technologies such as Azure Databricks and AWS, with hands-on experience in dbt modelling, anomaly detection, and SQL-based optimizations. Adept at workflow orchestration using Astronomer Airflow to ensure seamless data pipeline execution. Detail-oriented problem solver with strong analytical skills and a collaborative mindset, passionate about transforming raw data into actionable insights.

Overview

4
4
years of professional experience
5
5
years of post-secondary education

Work History

Data Engineer

Builder.ai
London, Greater London
11.2022 - Current

Experienced Data Engineer with expertise in SQL and Python, specializing in data streaming, ETL workflows, and cloud-based analytics. Proven ability to design, build, and maintain scalable data pipelines across multiple platforms for seamless data ingestion, transformation, and analysis. Adept at working in fast-paced environments, delivering high-quality results efficiently.

  • Designed, built, and optimized scalable data pipelines for seamless ingestion, transformation, and analysis across multiple platforms.
  • Developed and maintained ETL workflows using SQL, Python, and PySpark to enhance data processing efficiency.
  • Engineered and streamlined real-time and batch data streaming pipelines with Stitch, Fivetran, Segment, and custom Python scripts.
  • Processed and transformed marketing and CRM data to generate actionable insights.
  • Implemented and tested DBT models, anomaly detection, and validation processes to ensure data accuracy and reliability.
  • Orchestrated and automated data workflows using Astronomer Airflow for efficient scheduling and monitoring.
  • Documented and shared technical processes to improve cross-functional collaboration and knowledge transfer.

Associate

PwC India
Bangalore, India
06.2021 - 09.2021
  • SAP Trainee Associate who assisted in developing and optimizing applications and systems.
  • Contributed key insights to improve development plans for applications and programs.
  • Collaborated in a fast-paced environment, providing technical support and process improvements.

Education

Master of Science - Data Analytics

University of Warwick
Coventry
10.2021 - 10.2022

Bachelor of Technology - Computer Science and Engineering

SRM Institute of Science and Technology
Chennai, India
06.2017 - 05.2021

Skills

  • Programming & Scripting: SQL, Python, PySpark
  • Data Engineering & Streaming: ETL pipeline development, real-time & batch processing, Stitch, Fivetran, Segment
  • Cloud & Big Data: Azure Databricks, AWS, Unity Catalog
  • Data Modeling & Testing: DBT modelling, anomaly detection, data validation tests
  • Workflow Orchestration: Astronomer Airflow, pipeline scheduling & monitoring
  • Database Management & Documentation: SQL optimization, data transformations, cross-team documentation & collaboration

Languages

English
Fluent
Hindi
Native

Timeline

Data Engineer

Builder.ai
11.2022 - Current

Master of Science - Data Analytics

University of Warwick
10.2021 - 10.2022

Associate

PwC India
06.2021 - 09.2021

Bachelor of Technology - Computer Science and Engineering

SRM Institute of Science and Technology
06.2017 - 05.2021
Diksha Joshi