Pasan Perera
Oxford
Summary
With over seven years of experience in data engineering and business intelligence, expertise includes data pipeline development, data modeling, and analytics delivery. A professional journey marked by significant contributions to efficiency improvements, cost reductions, and enhanced data accuracy. Strong focus on team collaboration and achieving results, with flexible approach to adapting to changing requirements.
Overview
7
7
years of professional experience
1
1
Certification
Work History
Integration Developer
Penspen Ltd
01.2022 - Current
- Implementing ETL/ELT technologies to extract, transform, and load data, ensuring it's clean, consistent, and ready for analysis
- Designing & implementing scalable data pipelines to ingest, transform, and store data from multiple sources (Talend, CRM, internal databases)
- Managed Talend Cloud Management Console, overseeing the creation, updating, and deployment of Talend jobs to the cloud
- Scheduled and monitored Talend jobs, proactively troubleshooting log files and debugging job failures to ensure seamless integration workflows and minimize downtime
- Creating and maintaining dashboards using Power BI to visualize key metrics, helping teams make data-driven decisions
- Collaborating closely with teams across the business to deliver solutions suits their reporting needs
- Developing and optimising SQL queries for data extraction and reporting
- Automating data processes and improving efficiency through scripting (SQL)
- Developing and maintaining integration pipelines by consuming APIs to extract HR system data into a staging layer, ensuring efficient data processing and transformation based on specific HR, client, and stakeholder requirements
- Troubleshooting and resolving API-related failures, optimizing data flow reliability and minimizing downtime
- Designing, developing, and managing integrations between corporate systems, including HR platforms, Unit4 Finance System, and Office 365 Dynamics CRM, ensuring seamless data flow and operational efficiency across departments
- Providing Tier 2/3 support for integration-related incidents, working with internal teams and third-party vendors to resolve issues
- Creating and maintaining technical documentation for the integrations
- Participating in code reviews, discussions, and knowledge-sharing activities
- Communicate progress, challenges, and solutions to the team and stakeholders
- Key project: HR System & Payroll Integration – UAE Branch
- As part of the company's expansion into the UAE, I led the design and implementation of a new payroll system for the branch, ensuring seamless integration with their existing Smart HR platform
- Using Talend, I built a robust ETL pipeline that extracted employee and payroll-related data from our global HR system, transformed it according to UAE-specific payroll rules, and loaded it into Smart HR
- Once processed in Smart HR, the payroll data was further validated and used for financial reporting
- This solution automated payroll processing, eliminated manual intervention, and ensured compliance with local UAE labour laws, ultimately reducing payroll processing time by 50% and improving accuracy across the system
Big Data Engineer
N-ABLE Pvt Ltd
02.2019 - 12.2021
- Developed and optimized ETL pipelines using Talend, extracting, transforming, and loading data from multiple sources into Apache Hadoop (HDFS)
- Managed data ingestion and transformation workflows, reducing data latency from 1 day to 1 hour through automation and performance tuning
- Configured and administered Talend Administration Center (TAC) for efficient management of ETL workflows and data integration processes
- Worked with Cloudera Manager to deploy and maintain Hadoop clusters, ensuring high availability and performance
- Ensured data security, governance, and compliance standards across all ETL processes
- Developed high-quality, maintainable code to build a scalable and efficient big data platform
- Collaborated with product development teams to integrate data science solutions and support business intelligence initiatives
- Adopted DevOps & CI/CD methodologies to improve deployment efficiency and system reliability
- Engaged in continuous learning and training to stay updated with the latest big data and cloud technologies
- Took ownership of complex project tasks, demonstrating leadership in problem-solving and solution implementation
Data Engineer
N-ABLE Pvt Ltd
08.2018 - 02.2019
- Designed, developed, and maintained efficient and scalable data pipelines for ingesting data from various sources (APIs, third-party systems, databases) into data warehouse
- Wrote complex SQL queries to transform and manipulate data for analytics, reporting, and business intelligence needs
- Continuously monitored and optimized performance of data pipelines and data processing jobs to ensure fast, efficient data workflows
- Ensured systems and tools align with business requirements and industry standards
- Enhanced data quality and efficiency across business
- Optimised data delivery through indexing, query optimization, and continuously refactoring for better stability
- Used Git for source code management and collaborated with other team members to maintain a clean, organized, and efficient codebase
- Developed a company level finance dashboard by involving in the process starting from requirement gathering to dashboard deployment
- Designed and implemented data model for data repository including facts and dimensional tables
- Developed an automated data loading process to source target database of finance dashboard by developing SQL scripts responsible for ETL processes
- Developed and maintained ETL processes to source target database by migrating Excel-based sources to a target database by implementing complete process using Microsoft SSIS ETL flow tool
- Deployed SSIS flow, took backups, and troubleshot the process when needed, resolving data integrity issues by maintaining product category master data table
- Designed and developed the dashboard views, created necessary measures, and hosted the dashboard for different user groups using MS Power BI
- Documented data loading process and dashboard user guides for the users
Education
Bachelor of Science - Information Technology specialized in Data Science
Sri Lanka Institute of Information Technology
Skills
- Strong data modelling and database design skills
- Data visualization using Power BI
- Proficiency in ETL/ELT processes
- MSSQL Server Development & Administration, SSIS Packages
- Proficiency in SQL and data warehousing
- Understanding of different data modelling techniques (star and snowflake schemas etc)
- Familiarity with cloud data warehouses (AWS, Azure, GCP, or Snowflake)
- Strong analytical and problem-solving skills
- Excellent communication and collaboration skills
- Machine Learning, Statistical modelling (Python, R programming)
- Big Data (Apache Hadoop (HDFS))
- Certified in Microsoft Azure and Talend Big Data
- Familiarity with Azure Integration Services (AIS), Azure Functions, Azure Service Bus
- Identity and Access Management (IAM), Active Directory, SSO, OAuth, SAML
- Proficiency in languages C/C, Java, Python, Hive, Shell, SQL
- Analytical skills
- Problem-solving skills
- Communication skills
- Collaboration skills
Certification
- Microsoft Certified, Azure Fundamentals
- Azure Data Fundamentals (DP-900) Certification
- Talend Big Data v7 Certified Developer
- Talend Big Data Developer Practitioner
Publications
Paper name: Potential Upselling Customer Prediction Through User Behavior Analysis Based on CDR data.
Published in 2019 at 14th Conference on Industrial and Information Systems. (ICIIS)
Link to the paper: https://lnkd.in/gsUnhuV
Paper name: Analysing Payment Behaviours and Introducing an Optimal Credit Limit.
Published in 2019 at International Conference on Advancements in Computing (ICAC)
Link to the Paper: https://lnkd.in/gxa6zU3
References
Available on request.
Timeline
Integration Developer
Penspen Ltd
01.2022 - Current
Big Data Engineer
N-ABLE Pvt Ltd
02.2019 - 12.2021
Data Engineer
N-ABLE Pvt Ltd
08.2018 - 02.2019
Bachelor of Science - Information Technology specialized in Data Science
Sri Lanka Institute of Information Technology
Similar Profiles
Maryam Al MansooriMaryam Al Mansoori
Analyst at Penspen InternationalAnalyst at Penspen International
LIBIN GILBERTLIBIN GILBERT
Electrical Inspection Engineer at ADNOC Projects, PenspenElectrical Inspection Engineer at ADNOC Projects, Penspen
Livie SmelcerLivie Smelcer
Manager at The WoodsManager at The Woods