Ashwin Palaniswamy
Big Data Engineer/AWS/Informatica
Newcastle Upon Tyne,United Kingdom
Summary
Enthusiastic Big Data Engineer/ETL developer with Cloud Technology skills having around 12 years of experience eager to contribute to team success through hard work, attention to detail and excellent organizational skills. Organized and dependable candidate successful at managing multiple priorities with a positive attitude. Willingness to take on added responsibilities to meet team goals.
Overview
13
13
years of professional experience
6
6
years of post-secondary education
2
2
Certifications
Work History
Big Data Engineer
TATA CONSULTANCY SERVICES
Newcastle, Tyne and Wear
06.2018 - Current
- Playing a lead engineer role in developing applications in Spark Scala and Informatica BDM .
- Developing complex algorithms and ETL pipelines using Spark/Scala and Informatica BDM tool.
- Involved in developing products built in SAS in Hadoop environment paving way for decommission of applications in SAS environment.
- Developed ELT pipelines for both batch and stream processing using Informatica BDM.
- Automated pipelines to transport ETL data from on prem Hadoop Clusters to the Cloud based analytical environment in AWS.
- Unit Testing suite in Scala.
- CI/CD integration using GIT lab.
- Making data usable for various end user needs through Qliksense visualization tool.
- Liaising with coworkers and clients to elucidate the requirements for each task.
Senior Hadoop Developer
TATA CONSULTANCY SERVICES
Bengaluru, Karnataka
07.2017 - 05.2018
- Translate complex functional and technical requirements into detailed design suitable for building components in Hadoop environments .
- Performing a strategic review of all existing data streams to fully understand function's capabilities and areas of Development.
- Developed solutions in Spark and Scala .
- Designed and developed common load framework for 100 plus businesses through concurrent processing in Informatica.
- Used various sources such as Kafka micro service , Json inputs , oracle and teradata sources as well as third party semi structured data into data lake using Spark and Scala .
- Tuned existing Hadoop applications to boost performance.
- Developed highly maintainable Hadoop code and followed all best practices regarding coding.
Senior ETL Developer
TATA CONSULTANCY SERVICES
Charlotte, North Carolina
01.2016 - 06.2017
- As a senior Developer was involved in analyzing business process and gathering core business requirements .
- Leading a team of talented technical professionals through the on-going development and implementation of new BI processes and system.
- Designed ETL process to load data from source to target .
- Extensively used Teradata utilities like Fast-Load,MultiLoad,BTEQ and Fast Export.
- Implemented CDC logic through Informatica mapping and also through Teradata BTEQ.
- Used several transformations like Expression,Filter,Joiner and Lookup's for better Data messaging and also to migrate clean and consistent data.
- Testing and debugging of the code for all issues identified.
ETL Developer
TATA CONSULTANCY SERVICES
Bengaluru, Karnataka
04.2013 - 12.2016
- Designed and created ETL code installations, aiding in transitions for applications getting migrated from Mainframe/Teradata to Hadoop environment.
- Implement technical solutions as an ETL developer to perform and manage the extract , transform and load processes.
- Directed data transformations and transitions using Syncsort DMExpress Tool.
- Managed data quality issues during ETL processes, directing qualitative failures to team lead for improvements.
- Gathered, defined and refined requirements, led project design and oversaw implementation.
- Troubleshooting of long running jobs and fixing the issues .
Mainframe System Analyst
AXA TECHNOLOGY SERVICES INDIA PRIVATE LIMITED
Bengaluru, Karnataka
05.2011 - 04.2013
- Installed, maintained and supported application/source code and its components and subsystems.
- Detected ,diagnosed and reported Mainframe batch related problems.
- Involved in Analysis and resolution of incidents, problems or known errors related to abends/failures in mainframe application.
- Provided technical assistance to the programming staff in the analysis of application software amends, performance and resource consumption.
- Created and maintained complete documentation relative to the support of application software.
Mainframe Operator
IBM INDIA
Bengaluru, Karnataka
01.2010 - 04.2011
- Responsible for mainframe system operations and security administration for ZOS, MVS, RACF and ACF.
- Acted as a Mainframe system operator for MVS LPARs and User Administrator for RACF and ACF.
- Monitored the mainframe systems, batch operations and tape.
- Z/OS IPL/Shutdown of LPARS on weekly basis.
- Console Monitoring using the OMEGAMON, Netview and SAIOM tools.
- Batch job Monitoring(Using the CA7/11 and OPC)
- Cancel and Demand Mainframe batch jobs on request .
- Troubleshooting user problems using remote administering/viewing tools like Tivoli.
Education
Bachelor of Engineering - Computer Science
Anna University
Chennai 06.2005 - 05.2009
MBA - Operations Management
INDIRA GANDHI NATIONAL OPEN UNIVERSITY
NewDelhi 06.2013 - 05.2015
Skills
Big Data Frameworks - Hadoop,Spark ( Batch Processing , Spark SQL),Hive
Programming Languages - Scala , Shell Scripting
Databases - Teradata , MySQL , HBase
ETL Tools - Informatica , Syncsort DMExpress
AWS - EC2,S3,EMR,EBS,Cloudformation,EMR,Route53
Schedulers - Autosys , SOS Berlin Job Scheduler , Oozie
Control Systems - Git,Bitbucket,Jira,Confluence,SVN
Certification
Amazon Web Services Solutions Architect Associate
Timeline
Amazon Web Services Developer Associate
05-2021
Amazon Web Services Solutions Architect Associate
12-2019
Big Data Engineer
TATA CONSULTANCY SERVICES
06.2018 - Current
Senior Hadoop Developer
TATA CONSULTANCY SERVICES
07.2017 - 05.2018
Senior ETL Developer
TATA CONSULTANCY SERVICES
01.2016 - 06.2017
MBA - Operations Management
INDIRA GANDHI NATIONAL OPEN UNIVERSITY
06.2013 - 05.2015
ETL Developer
TATA CONSULTANCY SERVICES
04.2013 - 12.2016
Mainframe System Analyst
AXA TECHNOLOGY SERVICES INDIA PRIVATE LIMITED
05.2011 - 04.2013
Mainframe Operator
IBM INDIA
01.2010 - 04.2011
Bachelor of Engineering - Computer Science
Anna University
06.2005 - 05.2009