Koushik SARKAR

• Led the end-to-end AWS cloud transformation for a mission-critical enterprise Warehouse Management System(WMS), migrating core applications, Oracle databases, and enterprise integrations from on-premises infrastructure toAWS cloud architecture.
• Architected and implemented scalable, secure, and highly available AWS infrastructure supporting enterprisewarehouse operations and analytics platforms.
• Successfully delivered Oracle-to-AWS cloud database migration using AWS DMS with minimal downtime andcomplete data integrity.
• Designed event-driven enterprise integration architecture using AWS EventBridge, Lambda, Amazon SQS, and IFR-based integrations for near real-time communication across multiple enterprise systems.
• Developed automated operational workflows using AWS Systems Manager (SSM), significantly reducing manualoperational effort and improving support efficiency.
• Implemented enterprise-grade AWS networking architecture including VPCs, IAM controls, security configurations,routing, and connectivity aligned with cloud security best practices.
• Designed AWS Glue ETL pipelines integrating Oracle and Snowflake platforms, enabling enterprise reporting,analytics, and data modernization initiatives.
• Collaborated with infrastructure, security, database, and business stakeholders to ensure successful enterprise-wide cloud transformation delivery.
•Architected Built a reusable Databricks shared library (Scala/PySpark) adopted across all ingestion pipelines, standardising Ingestion patterns and error handling, Reusable transformation utilities, Logging, metrics, and observability.
•Act as Technical Lead and Platform Architect for a large-scale Azure & Databricks data platform supporting payment analytics and client onboarding.
• Improved scalability, operational resilience, system reliability, and automation while reducing infrastructuremanagement overhead through AWS managed services adoption

• Provided tailored advice to businesses based on individual needs assessments.

• Architected and developed enterprise-scale AWS data integration platforms for migrating millions of daily ERP (IFS) transactions into Snowflake with high availability, scalability, and fault tolerance.
• Designed and implemented end-to-end ETL pipelines using AWS Glue (PySpark 3.12) supporting Full Load, Incremental Load, and CDC (Insert, Update, Delete) processing.
• Built highly optimized AWS Glue Spark jobs capable of processing millions of records daily while maintaining excellent performance and data integrity.
• Designed complex AWS Step Functions workflows to orchestrate more than 100 AWS Glue jobs with intelligent dependency handling, retries, error recovery, and monitoring.
• Solved AWS subnet IP exhaustion by architecting a shared Glue execution framework that efficiently scheduled over 100 concurrent Glue jobs within subnets containing only 32 IP addresses.
• Automated event-driven data pipelines using Amazon EventBridge, enabling fully serverless scheduling and orchestration across multiple AWS services.
• Developed serverless microservices using AWS Lambda (Python 3.12) for data validation, metadata management, orchestration, notification, and operational automation.
• Engineered enterprise messaging solutions using Amazon SQS for asynchronous processing, workload decoupling, and resilient integration between distributed systems.
• Designed and implemented complete AWS networking infrastructure including VPCs, Transit Gateway, Private Subnets, Security Groups, Route Tables, and VPC Endpoints following AWS Well-Architected best practices.
• Eliminated public network dependencies by designing secure private connectivity architecture using AWS VPC Endpoints, significantly improving security and reducing network exposure.
• Developed Infrastructure as Code (IaC) using Terraform to provision and manage all AWS infrastructure, enabling repeatable deployments and environment consistency.
• Designed and developed Snowflake ingestion architecture including metadata-driven frameworks, staging strategy, ingestion pipelines, and optimized data loading processes.
• Built reusable AWS Glue frameworks and parameter-driven ETL components to accelerate future integrations while reducing development effort.
• Developed complex Python 3.12 applications using Apache Spark for large-scale distributed data transformation, optimization, cleansing, and validation.
• Implemented enterprise monitoring and observability using Dynatrace by creating custom metrics, dashboards, alerts, and end-to-end pipeline health monitoring.
• Integrated National Grid data into enterprise platforms through automated AWS-based integration pipelines utilizing Lambda, SQS, EventBridge, and Step Functions.
• Optimized ETL performance through Spark tuning, partitioning strategies, parallel execution, efficient data partition management, and resource optimization.
• Ensured end-to-end data quality by implementing automated validation, reconciliation, exception handling, logging, and audit frameworks throughout the integration lifecycle.
• Led complete solution architecture, technical design, development, deployment, and production support for multiple enterprise cloud integration projects independently.
• Collaborated with business stakeholders, architects, and cross-functional teams to translate business requirements into scalable, secure, and production-ready AWS cloud solutions.

•Extensive Development Experience in Reporting tools like POWER BI.
•Design the EDF learning management system from legacy SAP system to peoplefluent netdimension system.
•Worked as a main data migration architect as well as lead for migration of EDF Learning management system from SAP LSO system to SAS solution using AWS.
•Created Complex ETL Jobs in Oracle. Teradata , MS SQL SERVER.
•Developed Complex ETL/ELT pipelines for batch processing.
•Developed Complex data modeling for transforming SAP data into a SAAS solution.
•Implemented CI/CD pipelines in AWS DevOps using GIT and YAML templates for automated deployment in AWS.
•Developed Complex ETL/ELT pipelines for batch processing.
•Acted as the primary technical escalation point for complex data engineering and platform issues.

•Extensive Development Experience in Reporting tools like POWER BI, Tableau, SAP Business Object,QlikView.
•Worked on several migration project from RDBMS systems into AWS Cloud.
•Worked on several migration project to migrate onprem systems into AWS Cloud.
•Worked as Business 4.0 lead to implement manual solution in automated solution for EDF client.
•Worked as datamigration developer and architect for several projects which include SAP BW to SAP BO migration using SAP AO.
•Worked as datamigration developer and architect for several projects which include SAP BW to SAP BO migration using SAP AO.
•Data Modelling experience in MS POWER BI, MS SAS.
•Managed migration projects including BOXI 3.1 to BI 4.x upgrades and DevOps migration to GitHub and Jenkins.
•Collaborated closely with architects, analysts, and platform teams to ensure solutions aligned with enterprise standards.
•Ci/CD Implementation using GITLabs, Git, Jenkins.
•Collaborated closely with architects, analysts, and platform teams to ensure solutions aligned with enterprise standards.

• •Extensive Development Experience in Reporting tools like POWER BI, Tableau, SAP Business Object,QlikView.
  •Worked on several migration project to migrate RDBMS systems into AWS Cloud.
  •Worked on several project to migrate SAP BO upgrade from on prem to cloud(AWS/AZURE).
  •Worked on several project as a data analyst for GE client as well as EDF client.
  •Worked on several project as a ETL developer(Mainly INFORMATICA, matillion,Talend) for GE client.
  •Hadoop development Experience (Hive ,Sqoop, Spark).
  •Built Complex Pipelines with for batch as well as streaming processing
  •Experience with NoSQL Databases such as MongoDB.
  •Created Complex ETL Jobs in Oracle. Teradata , MS SQL SERVER.
  •Created Complex ETL Jobs in Hadoop using Spark(Scala and Python) loading data into Hive.
  •Experience with Apache Kafka system.
  •Acted as Technical Lead, Module Lead, Scrum Master, and Delivery Assurance Facilitator.
  •Collaborated closely with architects, analysts, and platform teams to ensure solutions aligned with enterprise standards.