VIPUL ROHILLA
SHEFFIELD,United Kingdom
Summary
- An adept data engineer with a specialization in Azure/AWS Cloud Engineering and a wealth of experience in Data Engineering. Skilled in configuring Hadoop, Hive, and Spark ETL workflows utilizing Nifi and SSIS. Proficient in data management using Azure Synapse Analytics, Azure Data Factory, and AWS Glue Catalog. Recognized for leadership, project accomplishments, and global client management. Notable achievements include maintaining 99% uptime, achieving a 40% reduction in processing time, and enhancing data accuracy by 30%. Proficient in BI tools such as SSRS, Power BI, and Tableau, crafting impactful data visualizations.
- Demonstrates an extensive grasp of Machine Learning algorithms, employing statistical techniques to extract valuable data-driven insights. Expertise extends to regression analysis, classification models, clustering, and time series forecasting. Implements decision trees, random forests, and support vector machines for precise predictive analytics. Committed to delivering innovative data engineering solutions that harness the potential of Machine Learning for informed business decision-making.
- Applies data warehousing principles encompassing star schema, snowflake schema, and data marts. Proficient in data modeling techniques like ER modeling and dimensional modeling, resulting in the successful execution of ten structured and efficient data architectures.
- Familiarity with significant big data technologies such as Hadoop, Spark, and Hive facilitates the processing of extensive volumes of structured and unstructured data, culminating in insights that contributed to a 25% enhancement in decision-making processes.
- Demonstrates expertise in utilizing BI tools like Power BI and Tableau for data visualization and reporting. Creation of twenty visually captivating and informative dashboards enriched data-driven decision-making.
- Experienced in executing migration and patching activities for SQL Server Databases across cloud and on-premises environments. Successfully migrated and updated fifty databases without incurring any downtime.
- Effectively collaborates with and manages operations teams for 24/7 support, ensuring a high 95% customer satisfaction rate and swift resolution of critical issues within a 30-minute response time.
Overview
11
11
years of professional experience
Work history
Assistant Manager
Interglobe Aviation Limited, Indigo Airlines
03.2021 - 08.2022
- Designed and developed ETL workflows on Azure and AWS platforms, proficiently loading data into AWS Redshift Warehouse and Azure Synapse Analytics.
- Skillfully utilized Azure Data Factory, AWS Glue, Polybase Server, and Amazon Athena to optimize data processing.
- Achieved a remarkable 40% reduction in data processing time and ensured improved data accuracy by implementing robust error-handling techniques.
- Streamlined data extraction, transformation, and loading operations enhance overall efficiency.
- Leveraged power of Azure Synapse Analytics and AWS Redshift for high-performance data warehousing capabilities.
- Ensured data quality and reliability by adhering to best practices in ETL development mechanisms, guaranteeing trustworthy and consistent results.
- Utilized different data models within Business Intelligence, including:
- Star Schema: Designing fact tables and dimension tables to facilitate quick data retrieval and analysis.
- Snowflake Schema: Normalizing dimension tables to reduce data redundancy and improve efficiency.
- OLAP (Online Analytical Processing) Cube: Pre-aggregating data to speed up complex queries and provide multidimensional analysis.
- Implemented various reporting and visualization models:
- Interactive Dashboards: Building dynamic and user-friendly dashboards to facilitate real-time insights and exploration.
- Drill-down Reports: Allowing users to delve deeper into specific data points for detailed analysis.
- Key Performance Indicators (KPIs): Displaying crucial metrics and performance indicators to monitor business goals effectively.
Database Engineer
Rackspace
04.2020 - 02.2021
- Leveraged SSIS for Business Intelligence initiatives, designing and implementing ETL workflows for data integration and transformation
- Developed robust data pipelines to extract, cleanse, and load data from various sources, enabling efficient and accurate data analysis
- Implemented data warehousing solutions using SSIS, including data modelling with star schema and snowflake schema for optimized querying and reporting
- Analyzed and resolved priority issues for multiple clients on SQL Server, achieving a 30% improvement in query response time
- Enhanced overall database performance through effective issue resolution, proactively addressing and resolving critical issues impacting query performance
- Optimized SQL Server configurations to maximize query response time, ensuring timely resolution of database-related issues to minimize downtime
- Successfully implemented techniques such as Replication, Mirroring, always-on, and Log Shipping, ensuring continuous availability and integrity of critical systems
- Achieved an impressive uptime of 99.99% for critical systems, minimizing data loss to less than 1% through effective disaster recovery strategies
- Proactively addressed and resolved issues impacting High availability and disaster recovery, ensuring continuous system reliability.
Cloud Analyst
Accenture Services Private Limited
08.2015 - 03.2020
- Configured Active Passive Configuration as the primary site and Disaster Recovery (DR) as an Availability Group (AAG).
- Completed installations for 20+ clusters, ensuring high availability and data protection.
- Installed SQL Server with the latest security patch to enhance system security.
- Ensured seamless failover and minimal downtime during system transitions.
- Managed and maintained 100+ instances on a shared Database server Environment.
- Successfully handled databases with sizes up to 10 TB.
- Ensured optimal performance and availability for critical systems.
- Actively monitored and maintained a large-scale database environment.
- Led and executed 40+ migration activities from planning to implementation.
- Successfully migrated over 100 databases from legacy versions (2005, 2008) to SQL Server 2012 and SQL Server 2016 environments.
- Oversaw the setup of cloud environments from scratch, ensuring seamless migration processes.
- Successfully migrated 30+ databases to cloud environments, achieving significant cost savings of 20%.
Software Engineer
e-tek Retail Solutions Private Limited
07.2011 - 12.2014
- Collaborated with team members to create applications' system analysis based on client requirements.
- Adapted to different languages and technologies based on project requirements.
- Performed regression and system-level testing to verify software quality and function prior to release.
- Drafted comprehensive technical reports to document bugs and design flaws.
Education
Master of Science - Big Data Analytics
Sheffield Hallam University
09.2023
Skills
- ETL Development using Azure ADF, AWS Glue, Apache Nifi, Oozie, Flume
- Cloud Data Warehouse: Azure Synapse Analytics and AWS Redshift
- Open Source Warehouses: Apache Hive
- Open Source Analytical Tools: Apache/Cloudera Impala, Apache Spark
- Data Modeling (Star Schema, Snowflake Schema)
- SQL Server Administration: Business Intelligence and Reporting
- Data Analysis Tool: SAS, Python, R
- Data Modelling and Visualization Tools: PowerBI, Tableau
- Machine Learning Models: Random Forest, NLP, Logistic Regression, Naive Bayes, and Support Vector
- Cloud Storage: Amazon S3, Azure Blob, and File Storage
- Monitoring Solutions: SQL Sentry, Redgate, and Naogis
- Analytical Thinking
- Team Collaboration
- Adaptability
- Documentation
- Problem Anticipation
- Presentation and communication expertise
- Agile framework understanding
- Problem-solving
- PowerShell tooling
- Microsoft Visual C#NET
- Analytical problem solving
- Reporting and documentation
- Training and development
- Risk mitigation planning
- Project lifecycle management
Languages
English
Fluent
Timeline
Assistant Manager
Interglobe Aviation Limited, Indigo Airlines
03.2021 - 08.2022
Database Engineer
Rackspace
04.2020 - 02.2021
Cloud Analyst
Accenture Services Private Limited
08.2015 - 03.2020
Software Engineer
e-tek Retail Solutions Private Limited
07.2011 - 12.2014
Master of Science - Big Data Analytics
Sheffield Hallam University
Similar Profiles
KOMAIL ALI MAKNOJIAKOMAIL ALI MAKNOJIA
Senior Aircraft Technician at Interglobe Aviation Limited - Indigo AirlinesSenior Aircraft Technician at Interglobe Aviation Limited - Indigo Airlines
KAVAN POOJARYKAVAN POOJARY
AIRPORT OPERATIONS & CUSTOMER SERVICES at INTERGLOBE AVIATION LIMITED. "Indigo Airlines"AIRPORT OPERATIONS & CUSTOMER SERVICES at INTERGLOBE AVIATION LIMITED. "Indigo Airlines"
Padmaja KPadmaja K
Senior Executive - Airport Operations and Customer at Interglobe Aviation Limited. ( Indigo Airlines)Senior Executive - Airport Operations and Customer at Interglobe Aviation Limited. ( Indigo Airlines)
Eleanor GoodyerEleanor Goodyer
FOH Team Member at Green KingFOH Team Member at Green King
Kairav Vipulkumar MehtaKairav Vipulkumar Mehta
QC Chemist at Gujarat Test Laboratory Pvt LtdQC Chemist at Gujarat Test Laboratory Pvt Ltd