Summary
Overview
Work history
Education
Skills
Timeline
Generic

Manjari Manokar

Manchester,Salford

Summary

Senior Data Engineer with 8 years of experience delivering end-to-end data solutions across GNPD, Satellite, Pharmaceutical, E-commerce, and Chemical sectors. Expertise in building real-time data pipelines, integrating complex data sources, and optimizing data warehouses with Snowflake, AWS. Skilled in ETL processes, data modeling, and workflow automation using Python, DBT, Azure Data Factory, Airflow and Fivetran.

Proven success in cost-effective data modeling, performance optimization, and ensuring data quality at scale. Experienced in CI/CD implementations with DataOps, mentoring teams, and leading cross-functional projects. Adept at leveraging AI/LLM technologies like OpenAI and Snowflake Cortex for advanced analytics and insights. Focused on driving data-driven decision-making and operational efficiency

Overview

8
8
years of professional experience
4
4
years of post-secondary education

Work history

Senior data engineer

Mintel
London
01.2023 - Current
  • Delivered 10 + data solution using Python, DBT, Snowflake, AWS, Kafka, Airflow, Fivetran and Snowpipe. Implemented Data warehouse and Marts using Data Vault & Kimball methodologies respectively and shared insights via Streamlit.
  • Designed data architecture (persistent staging, trust centers, blue-green deployment) to improve data quality and integrity.
  • Built AI/LLM solutions with OpenAI & Snowflake Cortex for RAG-based chatbots, similarity scoring and forecasts based on Prophet model on 8M+ records of semi and unstructured data.
  • Led cross-functional teams during manager absence, aligning stakeholders and delivering projects ahead of schedule by optimising workflows and focus.
  • Mentored 5+ engineers holding regular 1:1s running technical workshops and driving growth in Snowflake, DBT, and Python.
  • Collaborated with Product Owners, data scientists, and business stakeholders to ensure technical execution aligned with business goals, enabling better decision-making.
  • Optimized pipelines (25% faster, 20% cost reduction) by fine-tuning DBT models and Snowflake performance.
  • Implemented data governance practices, including security and compliance measures to safeguard data and maintain integrity.
  • Implemented automated data tests, unit tests, integration tests, engineering best practices and monitoring for data pipelines using Airflow and DBT, reducing manual intervention.
  • Administered Terraform & GitLab CI/CD pipelines, improving dev-ops efficiency and onboarding processes.

Senior DataOps Engineer

Mphasis Datalytyx
Manchester, Salford
06.2021 - 01.2023
  • Implemented real-time data solutions for satellite log data, building data pipelines using Python, DBT, and Snowflake, ensuring seamless data ingestion from CSV, JSON, and log files using an ELT approach.
  • Led the CI/CD implementation with DataOps, automating data modeling in DBT and managing Snowflake objects via SOLE (Snowflake Object Lifecycle Engine)
  • Migrated SharePoint and on-prem data to Azure Cloud using Data Factory and Synapse, improving ETL performance and data quality.
  • Created incremental data handling with Delta Lake and Watermark parquet files for better data consistency and pipeline scalability.
  • Developed Grafana dashboards for real-time insights, and managed integration of AWS IAM roles, EC2, and S3 for secure data operations in Snowflake.
  • Optimized and deployed pipelines using ARM Templates, reducing manual work and ensuring scalability.
  • Led system migrations, resolved production failures, and improved pipeline efficiency and data integrity.

Senior BI Solution Developer

Visual BI Solutions
Chennai, TamilNadu
07.2017 - 05.2021
  • Integrated and migrated data from ZOHO and OpenAir APIs to Snowflake, leveraging Azure Data Factory for ETL and automating workflows to convert nested JSON and XML data into structured formats.
  • Built analytic models in Snowflake using DBT, optimizing data warehousing for faster decision-making and reporting.
  • Developed cost-effective data models for large datasets in Azure Synapse, comparing Stored Procedures vs Mapping Data Flow for cost optimization across scenarios.
  • Moved data from HANA to Snowflake, parsing XML files with Python, and automating the creation of dynamic SQL for efficient data transformation.
  • Utilized Delta Lake and Watermark parquet files for incremental data handling in Azure Databricks, ensuring reliable and scalable data processing.
  • Streamlined CDC using Snowflake Streams and Tasks, optimizing data synchronization between Oracle and ZOHO API sources.
  • Created automated error handling in Azure Data Factory, including Logic Apps for real-time notifications, improving pipeline reliability and reducing manual interventions.
  • Optimized Snowflake performance by implementing Row-Level Security and Currency/UOM conversion logic for enhanced data access control.
  • Led migration projects from Oracle to SAP HANA and Snowflake, including data replication, HANA modeling, and visualization using SAC (SAP Analytics Cloud) for business insights.
  • Designed complex reports in WEBI, SAP Analytics Cloud, and Lumira, enabling key business functions like planning, predictions, and geo-data visualization

Education

Bachelor of Technology - Computer Science and Engineering

Sastra University
Thanjavur, TamilNadu
07.2013 - 06.2017

Skills

  • ETL and Data Engineering: Python, DBT, Fivetran, Snowflake SQL
  • Cloud and Data Warehousing: Snowflake, AWS (S3, EC2), Azure Synapse
  • Data Modeling: Data Vault, Kimball, Delta Lake
  • CI/CD and Automation: Terraform, GitLab, DataOps
  • Big Data & Streaming: Kafka, AWS Lambda, Snowpipe
  • AI and Analytics: OpenAI, Snowflake Cortex, LLM models
  • Security & Compliance: IAM, Data encryption, Trust Center
  • Optimization: Performance tuning, cost reduction
  • Visualization: Grafana, Streamlit

Timeline

Senior data engineer

Mintel
01.2023 - Current

Senior DataOps Engineer

Mphasis Datalytyx
06.2021 - 01.2023

Senior BI Solution Developer

Visual BI Solutions
07.2017 - 05.2021

Bachelor of Technology - Computer Science and Engineering

Sastra University
07.2013 - 06.2017

Similar Profiles

Create profile
Manjari Manokar