Summary
Overview
Work History
Education
Skills
Websites
Certification
Data Warehousing
Data Integration
Big Data Technologies
Version Control
Ci Cd
Database Systems
Cloud Security
Streaming Analytics
Data Modelling
Cloud Platforms
Nosql Databases
Awards
Projects
Timeline
Generic

Divya Sree Neela

Leicester,United Kingdom

Summary

Have 6 years of IT experience in gathering requirements, analysis, design, implementation, testing, deployment, and maintenance. Proficient in developing strategic methods for deploying Big Data solutions and Azure Services to efficiently solve data-driven solutions.

Overview

6
6
years of professional experience
1
1
Certification

Work History

Sr. Software Engineer

Tech Mahindra – Morgan Stanley
02.2021 - 11.2022
  • Analyse, design, and build Modern data solutions using Azure services and understand the current Production state of the application and determine the impact of new implementation on existing business processes
  • Ingested data from disparate data sources like SQL server, SFTP, Blobs, and Rest APIs using Azure Data Factory
  • Implemented PySpark transformations within Azure Databricks, elevating data accuracy by 18% in financial campaign reporting, supporting more informed decision-making
  • Spearheaded the development of data integration pipelines using Azure Data Factory, resulting in a 15% decrease in the time required for financial services data consolidation
  • Collaborated with data scientists to integrate machine learning models into the data processing pipeline for fraud detection and risk assessment
  • Achievements: Successfully developed and deployed a scalable financial advisory data crime detection solution that processed and analysed large volumes of both batch and streaming data, resulting in a 25% increase in fraud detection accuracy
  • Implemented real-time alerts and notifications for potentially fraudulent activities, reducing response time by 30% and minimizing financial losses to customers engaged.

Technology Analyst

Infosys – Microsoft
01.2020 - 02.2021
  • Orchestrated workflow, Utilized Azure Data Factory for data movement, transformation processes, ensuring efficient data processing and timely delivery
  • Created pipelines in ADF using datasets, linked services, batch services and email generators using logic apps to load data from MSQL server
  • Leveraged PySpark on Azure Databricks for advanced data processing tasks, including feature engineering, data enrichment, and model training
  • Utilized Spark to distribute data processing on datasets to improve ingestion and processing speed of the data by 23%
  • Automated workflows with Azure Functions and Logic Apps, reducing manual intervention and enhancing operational efficiency in managing Sales data workflows
  • Being part of the team in the sprint planning on user stories with daily operational duties
  • Achievements: Decreased customer transaction data consolidation time be 15%, improving the responsiveness of the Sales data infrastructure (Power BI)
  • Achieved a 25% increase in deployment frequency, ensuring updates to Sales systems and bolstering the strategies and offerings in line with evolving customer demands.

Senior System Engineer, Technology Analyst

Infosys – GE, Anthem and HCSC
01.2017 - 12.2019
  • Developed Spark applications using PySpark and Spark-SQL for data extraction, transformation, and aggregation from different file formats & data sources along data integration
  • Involved in different types of loads like Full Refresh, Incremental Merge and Custom Loads into hive and crafted custom UDF using spark-scala to meet business transition
  • Written the spark job to read data from kafka using spark streaming and updated the table metrics for data validation
  • Imported the different sources of data into HDFS and Hive using Sqoop
  • Automated ETL processes across billions of rows of data, which reduced manual workload by 30% monthly
  • Coordinating with the Onsite seed team in grooming the user stories for the upcoming sprint and responsible for preparing Low Level Design and technical design documents
  • Achievements: Enhanced query performance for healthcare data within the datalake by 20% through the implementation of optimized data storage strategies
  • This included refining file formats, compression techniques, and leveraging Spark's distribution fine-tuning methods
  • Implemented data validation processes that reduced data discrepancies by 8% and improved data integrity for Provider data.

Education

Masters (Ms) In Advanced Computer Science -

University Of Leicester
01.2024

Electronics and Communications -

JNTUH
04.2014

Skills

Data Engineering: Azure Data Lake, Databricks, Data Factory, PySpark, SQL, Python, Scala

Cloud Platforms: Azure

Data Modelling: Relational and Dimensional Data modelling, Star Schema, Snowflake Schema

Data Warehousing: Snowflake, Azure Synapse Analytics

Data Integration: ETL/ELT, Data Pipelines, Data Transformation

Big Data Technologies: Hadoop, Hive, Spark, Sqoop, Oozie, Impala

Version Control: Git

CI/CD:Continuous Integration, Continuous Deployment

Database Systems: SQL Server, Oracle, MySQL

Cloud Security: Key vault, IAM

Streaming Analytics: Azure Stream Analytics, Apache Kafka

NoSQL Databases: Cosmos DB

Certification

  • Academy Accreditation - Databricks Lakehouse fundamentals.
  • Microsoft Certified - Azure Data Engineer Associate (DP-203).

Data Warehousing

  • Snowflake
  • Azure Synapse Analytics

Data Integration

  • ETL/ELT
  • Data Pipelines
  • Data Transformation

Big Data Technologies

  • Hadoop
  • Hive
  • Spark
  • Sqoop
  • Oozie
  • Impala

Version Control

Git

Ci Cd

  • Continuous Integration
  • Continuous Deployment

Database Systems

  • SQL Server
  • Oracle
  • MySQL

Cloud Security

  • Key vault
  • IAM

Streaming Analytics

  • Azure Stream Analytics
  • Apache Kafka

Data Modelling

  • Relational and Dimensional Data modelling
  • Star Schema
  • Snowflake Schema

Cloud Platforms

Azure

Nosql Databases

Cosmos DB

Awards

Received the “Emerging Talent Award” from Infosys in recognition of contribution to Data Integration and provisioning to downstream.

Projects

Designed a system on Detection of Communities in Complex Networks – Graph data, for finding different metrics in the network which helps in detecting the targeting the customers in e-commerce apps alongside finding tightly knit networks.

Timeline

Sr. Software Engineer

Tech Mahindra – Morgan Stanley
02.2021 - 11.2022

Technology Analyst

Infosys – Microsoft
01.2020 - 02.2021

Senior System Engineer, Technology Analyst

Infosys – GE, Anthem and HCSC
01.2017 - 12.2019

Masters (Ms) In Advanced Computer Science -

University Of Leicester

Electronics and Communications -

JNTUH

Similar Profiles

CREATE PROFILE
Divya Sree Neela