Shikha Chaturvedi
Bristol
Summary
Results-oriented GCP Data Engineer with over 8+ of experience in designing, implementing, and optimizing end-to-end data solutions on the Google Cloud Platform. I specialize in developing robust ETL processes, optimizing data processing workflows, and ensuring data integrity.
My expertise includes proficiency in BigQuery, Cloud Storage, and Dataproc, enabling me to create high-performance data pipelines that meet the dynamic needs of diverse projects. Skilled in Python , Scala and SQL.
As a collaborative team player, I have a proven track record of working seamlessly with cross-functional teams to deliver data-driven insights that drive business outcomes. Certified as a GCP Associate Cloud Engineer and Google Cloud Professional Data Engineer, I am committed to staying current with emerging technologies and industry trends.
Overview
8
8
years of professional experience
4
4
years of post-secondary education
Work history
Lead Data Engineer
Virtusa Consulting (Client- Lloyds Banking Group)
London
09.2022 - Current
- Leading a team of 6 members in an offshore and onshore model
- Define and perform Data Products from legacy on-prem to Google Cloud Platform
- Design and develop scalable data processing systems on GCP using services using services like Cloud Storage, BigQuery, Dataproc, etc.
- Transform, cleanse, validate, and normalize data for analytical and operational use cases using data transformation framework
- Monitor and optimize data pipelines and architecture for performance, scalability, and cost
- Develop and maintain CI/CD processes to deploy and update data processing applications and pipelines.
- Used Big Data frameworks like Apache Spark, Apache
- Implement data quality and testing procedures to ensure accuracy and reliability.
- Communicate and collaborate across 10 teams to understand business needs and deliver data-driven solutions.
Lead Data Engineer
Virtusa Consulting (Client-Paypal)
Gurgaon
05.2021 - 05.2022
- Develop financial attributes to derive parameters and refresh data based on the type of data load like incremental and full load and frequency using HQLs
- Develop shell scripts to automate adhoc process and send email alerts
- Optimize data workflows and improved efficiency by implementing performance tuning techniques
Big Data Consultant
Deloitte USI [Client - Telstra]
Gurgaon
04.2019 - 05.2021
- Contributed in developing key modules of Generic Ingestion Framework using Spark and Scala
- Designed a Spark-Scala application to migrate from legacy to new systems
- Contributed as Ambari Admin to perform tasks such as managing user onboarding using Ranger, installing new services and resolving platform issues
- Integrated LDAP authentication system to support centralised access management
- Provide operational support and troubleshooting of defects to enable smooth ingestion
Sytems Engineer
TCS (Client - American Express)
Gurgaon
09.2015 - 03.2019
- Collaborate with cross functional users across Credit Risk Management to capture requirements and design innovative solutions
- Worked on Magellan tool to develop ETL pipelines for attributes using HQL and Spark-SQL
- Optimised the existing jobs and significantly reduced job run time
- Developed workflow for scheduling jobs using Event Engine (Scheduling Tool)
Education
Bachelor of Technology - Information Technology
Banasthali University
Jaipur , Rajasthan 07.2011 - 05.2015
Skills
- Hadoop
- Spark
- Google Cloud Platform
- Python
- Scala
- Apache Airflow
- Apache Oozie
- Cloud Composer
- Control-M
Bigdata Frameworks/Tools
Cloud
Programming Languages
Workflow Orchestration
Infrastructure as Code
- Terraform
- Jenkins
- Spinnaker
- Github
- Oracle
- MySQL
- Sprint planning, review and retro
- Banking
- Telecom
CI/CD
Databases
Agile Methodology
Domains Worked With
Additional Information
- GCP Professional Data Engineer
- GCP Associate Cloud Engineer
- AWS Cloud Practitioner
Timeline
Lead Data Engineer
Virtusa Consulting (Client- Lloyds Banking Group)
09.2022 - Current
Lead Data Engineer
Virtusa Consulting (Client-Paypal)
05.2021 - 05.2022
Big Data Consultant
Deloitte USI [Client - Telstra]
04.2019 - 05.2021
Sytems Engineer
TCS (Client - American Express)
09.2015 - 03.2019
Bachelor of Technology - Information Technology
Banasthali University
07.2011 - 05.2015
Similar Profiles
Prashant KamblePrashant Kamble
Data Governance Lead – Strategic Data Products at Virtusa Consulting- Client (Lloyds Banking Group)Data Governance Lead – Strategic Data Products at Virtusa Consulting- Client (Lloyds Banking Group)
Harish GundaHarish Gunda
Agile Delivery Manager at Virtusa - Lloyds Banking(Client)Agile Delivery Manager at Virtusa - Lloyds Banking(Client)
Shivakumar KammeriShivakumar Kammeri
Senior User Experience Designer at Lloyds Banking Group (Client - On-Site) - TCSSenior User Experience Designer at Lloyds Banking Group (Client - On-Site) - TCS
Emilia RieglEmilia Riegl
Cashier at G4S Cash SolutionsCashier at G4S Cash Solutions
Rosie BondRosie Bond
Copywriter & Strategist at Richmond DayCopywriter & Strategist at Richmond Day