Shashi Kiran

• Responsible for designing, industrializing and maintaining pharmaceutical systems (Manufacturing/Supply chain)
• Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
• Designed data models for complex analysis needs.
• Understanding business use cases for improving operational efficiencies
• Developed spark applications using Pyspark in Databricks/Hadoop for data extraction, transformation and aggregation from multiple file formats and different source systems for analyzing & transforming the data. Created UDF's and pivoting the rows to thousands of columns for data science requirements
• Developed automated data cleansing process to improve data quality and control totals check between source and target using Pyspark
• Developed data pipelines, scheduling, ingestion framework to ingest different source database tables and event based framework for CSV file ingestion in Azure Data Factory.
• Developed stream analytics for loading project specific parameters on to Delta Lake tables.
• Ingesting and transforming data on Azure Synapse required for reports & dashboard
• Developed ad-hoc datasets required for data science using python pandas
• Designed and developed scalable, ingestion framework using Python, Sqoop, HDFS and Linked server (SQL server) to ingest the data from different source systems and extract REST API data using Python
• Developed custom Microsoft Power BI dashboards, visualizations to deliver meaningful and actionable insights
• Developed Airflow DAGs for scheduling
• Implement and maintain CI/CD systems for deployment
• Manage source code repositories, branching strategies, release cycles and perform code reviews

• Data Migration from On-premise to AWS

• Act as principle developer developing spark programs using Scala & Python

• Regulatory projects such as Liquidity, FMIS, Basel 2, Corporate Solutions

Further Employment History Available Upon Request References Available Upon ReVuest