PRIYA CHOWDHURY
London
Summary
Reliable and Dynamic Data Engineer passionate about transforming data into actionable insights, I specialise in architecture and optimising complex data solutions. With a proven track record in stakeholder and team management, I excel in building and maintaining robust systems that ensure seamless workflows. My expertise spans data mining, warehousing, and analytics, leveraging cutting-edge Big Data and Cloud technologies to enhance database stability and security. Quality-driven and results-oriented, I am dedicated to delivering innovative methods that drive efficiency and mitigate risks. Adept at communication and project management, I thrive in collaborative environments that push the boundaries of data engineering.
Overview
10
10
years of professional experience
Work History
Lead Data Engineer
BCG X
London
11.2022 - Current
- Architected and developed scalable data pipelines and ETL processes to integrate and transform large datasets from various sources using Python, Spark, and cloud technologies (AWS/Azure).
- Led a team of data engineers, providing mentorship, guidance, and technical expertise to ensure successful project delivery and career growth of team members.
- Collaborated with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver high-quality data solutions.
- Designed and implemented data warehousing solutions, optimizing performance and ensuring data quality, security, and compliance with industry standards.
- Conducted performance tuning, monitoring, and troubleshooting of data infrastructure, ensuring high availability and reliability of data services.
Senior Data Engineer
ZAVA
London
07.2021 - 11.2022
- Led the data engineering domain to implement stakeholder requirements and optimize existing systems.
- Designed and implemented ETL solutions using Python, AWS, and Bash/Linux, ensuring data integrity and pipeline stability.
- Managed a terabyte-scale data warehouse, integrating data from various sources and improving legacy scripts.
- Outlined and initiated Data Lake and Data Quality projects.
- Prepared documentation and analytic reports, delivering summarized results to stakeholders.
Senior Data Engineer
Microsoft
Hyderabad
06.2019 - 07.2021
- Managed teams of 4-7 people to implement data engineering solutions for global clients.
- Designed and implemented ETL solutions using Python/Scala, Azure, and Spark.
- Supported clients with business analysis, architecture, implementation, documentation, and data modeling.
- Developed Intellectual Properties (IPs) and improved organizational practices and systems.
- Integrated technology and business operations to provide targeted solutions and reduce expenditures.
Data Engineer
Deloitte
Hyderabad
09.2017 - 05.2019
- Collaborated with teams to define, strategize, and implement data engineering solutions using Java/Python/Scala, Spark, and Bash/Linux.
- Supported clients with business analysis, architecture, implementation, documentation, and data modeling, reducing expenditures and increasing savings.
- Developed various data engineering tools as part of firm initiatives to address client issues and improve operational efficiency.
Data Engineer
Tata Consultancy Services
Hyderabad
08.2015 - 09.2017
- Migrated existing systems to Big Data platforms using Spark, developing and maintaining ETL solutions with Java/Python, Spark, and Bash/Linux.
- Analyzed complex data to identify anomalies, trends, and risks, providing insights to improve internal controls and maintain data integrity.
- Contributed to process improvements and innovations, enhancing overall efficiency and effectiveness in data analytics and handling.
Education
Bachelor of Technology -
West Bengal University of Technology
08.2015
Skills
- ETL/ELT Pipelines
- SQL
- Python
- Spark
- Cloud Technologies
- Data Warehousing and Optimisations
- Data Engineering and Analysis
- Data Architecture
- Communication
- Team Management
Languages
- Hindi
- English
- Bengali
Timeline
Lead Data Engineer
BCG X
11.2022 - Current
Senior Data Engineer
ZAVA
07.2021 - 11.2022
Senior Data Engineer
Microsoft
06.2019 - 07.2021
Data Engineer
Deloitte
09.2017 - 05.2019
Data Engineer
Tata Consultancy Services
08.2015 - 09.2017
Bachelor of Technology -
West Bengal University of Technology
Similar Profiles
Priyanshu JainPriyanshu Jain
Job Simulations at BCG XJob Simulations at BCG X
CHETAN GUPTACHETAN GUPTA
Talent Acquisition Leader – APAC & India at Boston Consulting Group (BCG) – Global ServicesTalent Acquisition Leader – APAC & India at Boston Consulting Group (BCG) – Global Services
Khalid AlSaifKhalid AlSaif
Senior Analyst - People & Organization at BCGSenior Analyst - People & Organization at BCG
Mohanad Abdel-RahmanMohanad Abdel-Rahman
Academic Peer Tutor at NAAcademic Peer Tutor at NA
Erdrin RexhepiErdrin Rexhepi
Sales & Operations Assistant at Original Fire LtdSales & Operations Assistant at Original Fire Ltd