Overview
CAREER OBJECTIVE
Work History
Education
Skills
Websites
PERSONAL DETAILS
PERSONAL DETAILS
Personal Information
Disclaimer
Timeline
Data Engineer

Yaswanth Pullagura

B&M Retail DC
Edinburgh,EDH
6
Years of experience
1
Language

? To obtain a challenging career, seeking position in the environment where my skills & abilities could be used in right direction and up to full potential, leading to my maximum contribution to my organization.

? Data Engineer with 4+ years of overall IT experience in data engineering and data processing. ? Hands-on experience in developing, maintaining, and supporting ETL/ELT data pipelines using PySpark, Apache Spark, and Databricks. ? Proficient in Python and SQL for data transformation, processing, and analysis. ? Experience working with Microsoft Azure and AWS cloud platforms for data engineering and migration projects. ? Skilled in processing large datasets using distributed computing technologies and optimizing data workflows. ? Experienced in data migration, data integration, data validation, and pipeline troubleshooting. ? Started career at TCS in a BPO role and transitioned into IT through internal training and hands-on technical experience. ? Strong analytical thinking, problem-solving, teamwork, and adaptability to new technologies. ? Maintaining good Relationships with the Consultants. ? Having very good knowledge of SDLC, and various technologies like Java, .Net, DevOps, QA, Data Engineer, Python, Business Analyst, Salesforce.

Work History

Data Engineer (PySpark / Databricks / Azure)

3 Years 4 Months
B&M Retail DC | 09.2022 - 01.2026
  • Developed and maintained PySpark ETL pipelines in Azure Databricks to ingest and transform data from multiple source systems.
  • Implemented Delta Lake for reliable and scalable storage, enabling schema evolution and time-travel features.
  • Created and managed Azure Data Factory pipelines to schedule and orchestrate Databricks workloads.
  • Tuned Spark jobs using partitioning, caching, and query optimizations to improve performance and reduce costs.
  • Integrated Kafka streams for near real-time data processing.
  • Worked on REST API-based data ingestion and automated loading into cloud storage.
  • Supported cross-cloud integrations involving AWS services such as S3, EC2, and Lambda.
  • Performed unit testing using pytest and supported CI/CD pipelines using Jenkins.
  • Participated actively in Agile ceremonies and collaborated with business and product teams.
  • Implemented basic data quality checks and validations across ETL pipelines.
  • Assisted in migrating Java-based data outputs into centralized Delta tables.
  • Project Overview: Worked on modernizing financial servicing applications by migrating legacy data workflows to Azure Databricks. The project supports personal and small business account systems used for pricing, fee calculation, waivers, and downstream customer applications.
  • Environment: PySpark, Databricks, Azure ADF, ADLS, AWS S3, Lambda, Kafka, Delta Lake, SQL, Git, Jenkins, Jira

BPO Associate Trainer

2 Years
Tata Consultancy Services (TCS) | 01.2020 - 01.2022
  • Performed day-to-day BPO operations during the initial year, following defined business processes.
  • Completed internal IT training programs focused on Python fundamentals and basic programming concepts.
  • Assisted senior team members with simple Python scripts, data formatting, and small automation tasks.
  • Gained exposure to basic application support and backend data handling.
  • Used this role as a foundation to build technical skills and move into full-time IT and data roles later.
  • Experience Summary: Joined TCS as a BPO Associate, where I spent the first year handling operational and process-driven work. After internal training and assessments, I was transitioned into the IT domain as a trainee. During this phase, I started working with Python and basic scripting tasks, which helped build a foundation for my data engineering career.

Education

Master's Degree - Data Science and Analytics

University of Hertfordshire | 01.2024

Skills

Programming Languages: Python
SQL
PySpark
Big Data Technologies: Apache Spark
Spark SQL
Distributed Data Processing
Data Engineering: ETL/ELT Pipelines
Data Transformation
Data Integration
Data Validation
Cloud Platforms: Microsoft Azure
Amazon Web Services (AWS)
Data Platforms: Databricks
Cloud-Based Data Processing
Data Management: Data Migration
Large-Scale Data Processing
Data Quality
Data Pipeline Monitoring and Troubleshooting
Core Competencies: Problem-Solving
Analytical Thinking
Team Collaboration
Adaptability
Continuous Learning

PERSONAL DETAILS

Linguistic Abilities English, Telugu, Hindi

PERSONAL DETAILS

Father Name P. Lakman Rao

Personal Information

  • Gender: male
  • Marital Status: Bachelor.

Disclaimer

I hereby declare that information furnished by me is true to the best of my knowledge. Place: Date: Yaswanth P

Timeline

Data Engineer (PySpark / Databricks / Azure)

B&M Retail DC
09.2022 - 01.2026Read More

BPO Associate Trainer

Tata Consultancy Services (TCS)
01.2020 - 01.2022Read More

University of Hertfordshire

Master's Degree from Data Science and Analytics
Read More
Yaswanth PullaguraData Engineer