Summary
Overview
Work History
Education
Skills
Websites
Certification
Timeline
Generic

Arun Sharma

Summary

Experienced technology professional with 13 years of expertise in implementing data-driven solutions. Skilled in data engineering, data warehouse design, and data modeling across various industries such as airlines and healthcare. Successful in improving data architecture, developing common architecture, and constructing Data Lakehouse in Azure cloud.

Overview

14
14
years of professional experience
1
1
Certification

Work History

Sr. Data Engineer

Tata Consultancy Services
01.2019 - Current
  • Extensive hands-on expertise across the entire Azure Data Services stack
  • Proven ability to design, implement, and manage scalable data solutions that drive business intelligence and analytics
  • Leading efforts to build a robust data-driven system that supports the company’s analytical, data science and operational needs
  • Collaborate closely with the stakeholders and business analysts to understand business requirements and translate them into technical solutions
  • Ensuring data security and compliance by implementing best practices for data governance and monitoring across azure services
  • Designed and implemented a robust data platform architecture that enabled seamless integration from over 10 distinct structured and unstructured data sources, including SharePoint, enhancing overall system efficiency by 30%
  • Implemented metadata-driven ingestion framework using Azure Databricks and Data Factory
  • Enhanced reusability, productivity and maintainability by automating data ingestion processes and reducing manual intervention
  • Implemented industry best practices to improve the efficiency of data pipelines, data accuracy and relevance for customer-centric analytics and reporting
  • Migrated on-premises data stores to Azure services
  • Achieved accuracy to deliver proof of concepts (POCs) to senior management

Data Engineer

Tata Consultancy Services
07.2016 - 12.2019
  • Implemented data solutions using Talend Tool
  • Fostered a collaborative environment to drive innovation and efficiency in data projects
  • Designed the architecture for and implemented data warehouses and data pipelines
  • Implemented ITIL best practices, change and problem as per the requirements

Senior Software Engineer

Sopra Steria India Pvt Ltd
11.2013 - 02.2016
  • Achieved and completed Managed file Transfer (MFT) on the EDI domain using the Axway products Gateway Interchange and CFT
  • Part of the Integration team, responsible for gathering all the requirements required to create interface between two applications
  • Writing Shell Scripts to automate the manual tasks

Software Engineer

Tech Mahindra
12.2010 - 11.2013
  • Achieved and implemented code application development/Support in Shell scripting and SQL
  • Strengthened the Billing Application for the maintenance and support

Education

Bachelor of Technology - Computer Science & Engineering

Amity University
05.2016

Skills

  • Databricks
  • PySpark
  • SparkSQL
  • Medallion Architecture
  • Microsoft Fabric
  • Azure Data Factory
  • Delta Lakehouse
  • Azure Synapse Analytics
  • Azure Datalake Gen2
  • Azure Analysis Services
  • RDBMS
  • PostgreSQL
  • SQL Server
  • MySQL
  • Unity Catalog
  • Data Quality
  • Data Security
  • Encryption
  • Anonymization
  • Pseudonymization
  • GDPR
  • Data Modelling
  • Data Warehouse Design
  • Kimball
  • Azure
  • AWS
  • Python
  • SQL
  • Azure Functions
  • Logic Apps
  • Streaming Services
  • Stream Analytics
  • Event Hubs
  • EventGrid
  • ServiceBus
  • Log Analytics
  • KeyVault
  • App Services
  • Application Insights
  • Azure DevOps
  • Git
  • CI/CD
  • DataOps
  • Wiki
  • Jira
  • Confluence
  • Agile
  • Scrum
  • ETL development

Certification

  • Databricks Certified Data Engineer Professional
  • Microsoft Certified: Azure Data Engineer (DP-203)

Timeline

Sr. Data Engineer

Tata Consultancy Services
01.2019 - Current

Data Engineer

Tata Consultancy Services
07.2016 - 12.2019

Senior Software Engineer

Sopra Steria India Pvt Ltd
11.2013 - 02.2016

Software Engineer

Tech Mahindra
12.2010 - 11.2013

Bachelor of Technology - Computer Science & Engineering

Amity University
Arun Sharma