Arun Sharma
Summary
Experienced technology professional with 13 years of expertise in implementing data-driven solutions. Skilled in data engineering, data warehouse design, and data modeling across various industries such as airlines and healthcare. Successful in improving data architecture, developing common architecture, and constructing Data Lakehouse in Azure cloud.
Overview
14
14
years of professional experience
1
1
Certification
Work History
Sr. Data Engineer
Tata Consultancy Services
01.2019 - Current
- Extensive hands-on expertise across the entire Azure Data Services stack
- Proven ability to design, implement, and manage scalable data solutions that drive business intelligence and analytics
- Leading efforts to build a robust data-driven system that supports the company’s analytical, data science and operational needs
- Collaborate closely with the stakeholders and business analysts to understand business requirements and translate them into technical solutions
- Ensuring data security and compliance by implementing best practices for data governance and monitoring across azure services
- Designed and implemented a robust data platform architecture that enabled seamless integration from over 10 distinct structured and unstructured data sources, including SharePoint, enhancing overall system efficiency by 30%
- Implemented metadata-driven ingestion framework using Azure Databricks and Data Factory
- Enhanced reusability, productivity and maintainability by automating data ingestion processes and reducing manual intervention
- Implemented industry best practices to improve the efficiency of data pipelines, data accuracy and relevance for customer-centric analytics and reporting
- Migrated on-premises data stores to Azure services
- Achieved accuracy to deliver proof of concepts (POCs) to senior management
Data Engineer
Tata Consultancy Services
07.2016 - 12.2019
- Implemented data solutions using Talend Tool
- Fostered a collaborative environment to drive innovation and efficiency in data projects
- Designed the architecture for and implemented data warehouses and data pipelines
- Implemented ITIL best practices, change and problem as per the requirements
Senior Software Engineer
Sopra Steria India Pvt Ltd
11.2013 - 02.2016
- Achieved and completed Managed file Transfer (MFT) on the EDI domain using the Axway products Gateway Interchange and CFT
- Part of the Integration team, responsible for gathering all the requirements required to create interface between two applications
- Writing Shell Scripts to automate the manual tasks
Software Engineer
Tech Mahindra
12.2010 - 11.2013
- Achieved and implemented code application development/Support in Shell scripting and SQL
- Strengthened the Billing Application for the maintenance and support
Education
Bachelor of Technology - Computer Science & Engineering
Amity University
05.2016
Skills
- Databricks
- PySpark
- SparkSQL
- Medallion Architecture
- Microsoft Fabric
- Azure Data Factory
- Delta Lakehouse
- Azure Synapse Analytics
- Azure Datalake Gen2
- Azure Analysis Services
- RDBMS
- PostgreSQL
- SQL Server
- MySQL
- Unity Catalog
- Data Quality
- Data Security
- Encryption
- Anonymization
- Pseudonymization
- GDPR
- Data Modelling
- Data Warehouse Design
- Kimball
- Azure
- AWS
- Python
- SQL
- Azure Functions
- Logic Apps
- Streaming Services
- Stream Analytics
- Event Hubs
- EventGrid
- ServiceBus
- Log Analytics
- KeyVault
- App Services
- Application Insights
- Azure DevOps
- Git
- CI/CD
- DataOps
- Wiki
- Jira
- Confluence
- Agile
- Scrum
- ETL development
Certification
- Databricks Certified Data Engineer Professional
- Microsoft Certified: Azure Data Engineer (DP-203)
Timeline
Sr. Data Engineer
Tata Consultancy Services
01.2019 - Current
Data Engineer
Tata Consultancy Services
07.2016 - 12.2019
Senior Software Engineer
Sopra Steria India Pvt Ltd
11.2013 - 02.2016
Software Engineer
Tech Mahindra
12.2010 - 11.2013
Bachelor of Technology - Computer Science & Engineering
Amity University
Similar Profiles
Vrunda ChindhadeVrunda Chindhade
HR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services LimitedHR Manager at Tata Consultancy Services, TCS, Tata Consultancy Services Limited
Sreya BasuSreya Basu
Procare Analyst at Tata Steel(Tata Consultancy Services)Procare Analyst at Tata Steel(Tata Consultancy Services)
Arun VArun V
Program Manager at Tata consultancy services | Financial Ombudsman ServicesProgram Manager at Tata consultancy services | Financial Ombudsman Services
Naimish AgnihotriNaimish Agnihotri
Assistant Delivery Manager at Tata Consultancy Services, Global Shared ServicesAssistant Delivery Manager at Tata Consultancy Services, Global Shared Services
AMIT KUMARAMIT KUMAR
Sr. Data Engineer at Celebal TechnologySr. Data Engineer at Celebal Technology