Subhajit Dutta
Kolkata
Summary
Lead Data Engineer with 12+ years of experience across Oracle database engineering and Azure cloud data platforms. Extensive background in PL/SQL development, data migration, and performance optimization, complemented by hands-on Azure Data Engineering using ADF, Databricks (PySpark), and Azure SQL. Proven ability to work directly with onshore clients and senior stakeholders, drive requirement workshops, provide technical leadership, and deliver data solutions aligned with UK regulatory and business needs.
Overview
12
12
years of professional experience
4
4
years of post-secondary education
1
1
Certification
Work history
Data Engineer
Tata Consultancy Services
Kolkata
05.2021 - 12.2025
- Built end-to-end data pipelines using Azure Data Factory, PySpark, SQL, and PL/SQL to support pensions operations, actuarial reporting, and regulatory initiatives.
- Integrated data from policy admin systems, annuity platforms, and servicing applications into scalable ETL workflows.
- Designed data models for schemes, valuations, member movements, transfers, and financial reporting.
- Used SQL & PL/SQL optimisation techniques to improve PySpark job efficiency and batch processing times.
- Delivered CI/CD deployments via Azure DevOps and developed reusable components for ETL processes.
- Supported data investigations, scheme reconciliations, and issue analysis leveraging strong SQL problem-solving.
Senior Software Engineer
Capgemini
Hyderabad
06.2018 - 05.2021
- Developed and enhanced Wealth module components using Oracle PL/SQL and Finacle customisation.
- Optimised batch processes for valuations, portfolio updates, order execution, and customer transactions.
- Built Unix shell scripts for automation, file handling, and scheduled processes.
- Improved application and DB performance through SQL tuning and efficient stored procedure design.
Software Engineer
EdgeVerve
Hyderabad
08.2016 - 06.2018
- Supported wealth management workflows including deposits, investments, and portfolio services.
- Developed PL/SQL procedures for transaction posting, NAV updates, ledger sync, and fee computation.
- Enhanced Finacle screens using JavaScript for improved UX and operations efficiency.
- Wrote Unix scripts for job automation, reporting, and file transfers.
- Participated in UAT, deployment support, and defect resolution.
Software Engineer
Tech Mahindra
Hyderabad
01.2014 - 08.2016
- Supported healthcare data workflows involving patient records, appointments, billing, and provider data.
- Performed SQL/PLSQL-based data extraction, transformation, and validation tasks.
- Developed Unix scripts for automation and batch processing.
- Assisted with UAT, documentation, defect triage, and production support.
Education
Bachelor of Technology (B.Tech) - Electronics and Communication Engineering
West Bengal University of Technology
08.2009 - 06.2013
Skills
- Azure Data Factory and Databricks
- Data pipeline development and ETL design
- Cloud data integration
- SQL optimization
- CI/CD implementation
- PySpark and Python programming
- Oracle PL/SQL
- Unix shell scripting
- JavaScript basics
- Version control with Git
- Stakeholder collaboration
- Agile practices
- Technical leadership
Certification
- DP-700: Microsoft Azure Data Engineering
- Nov 2025 - Nov 2026
Timeline
Data Engineer
Tata Consultancy Services
05.2021 - 12.2025
Senior Software Engineer
Capgemini
06.2018 - 05.2021
Software Engineer
EdgeVerve
08.2016 - 06.2018
Software Engineer
Tech Mahindra
01.2014 - 08.2016
Bachelor of Technology (B.Tech) - Electronics and Communication Engineering
West Bengal University of Technology
08.2009 - 06.2013