ABHISHIKTH VISHNUMOLAKALA
Crew,CHE
Summary
Results-driven Data Engineer with nearly 5 years of experience in designing and implementing robust data solutions across diverse environments. Currently at CDL Software, where I leverage AWS services, ETL pipeline development, and automation to drive continuous improvement and innovation. Expert in integrating AWS Glue with PowerBI, managing Docker containers with ECS, and utilizing Terraform for Infrastructure as Code. Demonstrated proficiency in Python development, PostgreSQL optimization, and creating comprehensive technical documentation. Previously at Concentrix, specializing in ETL, CDC data pipelines, and ML data preprocessing. Holds an MSc in Artificial Intelligence and Robotics and multiple AWS and Terraform certifications. Committed to enhancing data workflows and operational efficiencies through innovative solutions and advanced techniques.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Data Engineer
CDL Software
06.2022 - Current
- AWS Glue and PowerBI Integration: Configured AWS Glue Catalog Tables and integrated Athena with PowerBI using Simba ODBC for seamless data refreshes
- ETL Pipelines: Designed and implemented ETL pipelines using AWS services (ECR, ECS, EventBridge, AWS Glue). Managed data processing, transformation, and delivery to S3 buckets with automated SFTP triggers.
- Automation: Developed automation solutions with PowerShell, Bash, Python, and Rundeck to streamline workflows and improve efficiency.
- Terraform: Used Terraform and Terragrunt for Infrastructure as Code (IaC) to deploy and manage AWS cloud services.
- Terraform Drift Detection Solution: Created a dynamic drift detection solution by combining Terraform with a custom Python module for enhanced infrastructure monitoring.
- CI/CD Pipeline Development: Developed and implemented CI/CD pipelines in GitLab, automating build, test, and deployment processes to enhance efficiency and reliability across projects.
- Docker & AWS Integration: Managed Docker containers and multi-container applications, leveraging Amazon ECS and ECR for deployment and orchestration.
- PostgreSQL: Optimised PostgreSQL queries and developed PL/pgSQL scripts for complex business logic.
- Python Development: Developed Python scripts for diverse applications, employing advanced techniques and object-oriented programming for performance enhancement.
- Additional Contributions: Implemented Elasticsearch for monitoring and alerts, integrated ServiceNow API for automated incident management, and created comprehensive technical documentation.
Big Data Engineer
Concentrix
04.2017 - 08.2019
- CDC Data Pipelines: Developed Change Data Capture (CDC) pipelines with PySpark, Qlik replicator, RDS, and AWS Glue.
- ETL Pipelines: Designed ETL pipelines with Python, pandas, and PostgreSQL for efficient data extraction, transformation, and loading.
- ML Data Preprocessing: Conducted data preprocessing to support machine learning model recommendations.
- Data Visualisation: Implemented visualisation solutions with Seaborn and Matplotlib to aid data interpretation.
Education
Master of Science - MSc Artificial Intelligence And Robotics, Artifici
University of Hertfordshire
Hatfield, United Kingdom09.2021
Bachelor of Science - Computer Science
Jawaharlal Nehru Technological University
Hyderabad, India12.2016
Skills
- AWS Services Expertise
- Continuous Integration and Deployment
- ETL Design and Implementation
- Containerization Technologies
- PowerShell Scripting
- Big Data Processing
- Performance Tuning
- Bash Scripting
- Terraform Expertise
- Python
- PostgreSQL Experience
Certification
- AWS Certified Cloud – Practitioner
- AWS Certified Developer – Associate
- HashiCorp Certified: Terraform Associate (003)
Timeline
Data Engineer
CDL Software
06.2022 - Current
Big Data Engineer
Concentrix
04.2017 - 08.2019
Master of Science - MSc Artificial Intelligence And Robotics, Artifici
University of Hertfordshire
Bachelor of Science - Computer Science
Jawaharlal Nehru Technological University
Similar Profiles
Thurinton W. Harvell Jr.Thurinton W. Harvell Jr.
Mover at CDL AND NON-CDL DriversMover at CDL AND NON-CDL Drivers
Yuleidy FriasYuleidy Frias
MPC at CDL DriverMPC at CDL Driver
Adrián De La Paz OcampoAdrián De La Paz Ocampo
CDL Instructor at ROADPRO CDL TrainingCDL Instructor at ROADPRO CDL Training
Solomon SerghiSolomon Serghi
El Fourno at pot washerEl Fourno at pot washer
`OMOLARA Akinseye`OMOLARA Akinseye
Crew Team Member at RoadchefCrew Team Member at Roadchef