Work preference
Summary
Overview
Work history
Education
Skills
Certification
ACHIEVEMENTS
Languages
Work availability
Timeline
Generic
Faraz Khan
Open to work

Faraz Khan

Bangalore,India

Work preference

Job search status

Open to work
Preferred start date: Negotiable

Desired job title

Senior Test Automation EngineerTest Automation EngineerTest Automation Engineer

Work Type

Full time

Location preference

On-siteRemoteHybrid
Location: Bangalore, India
Open to relocation: Yes

Salary range

200000/yr - 2000000/yr

Important to me

Career advancementWork-life balanceCompany cultureFlexible work hoursHealthcare benefitsWorking remotely optionPaid sick leavePersonal development programmes4-day work week

Summary

Senior Test Automation Engineer with 7 years of experience owning test automation, API validation, and release quality for insurance, finance, and logistics platforms. Designed Python/Pytest and Selenium frameworks; integrated automated suites with Jenkins; and containerized execution using Docker and Kubernetes. Experienced in test strategy, risk-based coverage, API testing, defect root-cause analysis, quality metrics, and mentoring engineers. Nearly 3 years of experience validating GenAI and RAG systems using deterministic checks, DeepEval, and Ragas.

Overview

1
1
Certification
2
2
Languages

Work history

Senior Test Automation Engineer

Happiest Minds and Technologies Pvt Ltd
Bangalore, India
02 2025 - 08.2026
  • Project: Hexure-FireLight (Insurance Form & Wizard Platform)
  • Tech Stack: Gen AI, Python, Selenium, Pytest, DeepEval, REST APIs, Requests, Kubernetes, Docker, and AWS.
  • Description: Contributed to AI integration testing for Hexure FireLight, insurance services platform used to create forms and wizards via drag-and-drop functionality. Project focused on enhancing platform capabilities through AI-driven automation.
  • Owned test strategy and automation approach for PDF-to-form conversion, automatic field tagging and LLM-powered rule-builder chatbot, covering UI, REST APIs, generated JSON layouts and XML business rules.
  • Enhanced Python/Pytest framework with reusable API clients, fixtures, configuration management, centralized logging and shared UI/API/AI validation utilities.
  • Automated validation of more than 50 PDF forms and associated field mappings, reducing manual verification time from four days to three hours per release.
  • Built deterministic validations for coordinates, labels, field types, required attributes and XML rules, combined with DeepEval-based faithfulness, hallucination, bias and safety evaluations.
  • Created F1-score-based validation for AI-generated field tags and evaluated thresholds for release qualification.
  • Defined and tracked quality metrics for automation coverage, pass rate, defect leakage, and flaky-test rate.
  • Integrated smoke and regression suites with Jenkins and Docker-based parallel execution, reducing regression time from five working days to one day.
  • Conducted requirement reviews, automation pull-request reviews and defect RCA while mentoring junior engineers.

Test Automation Engineer

CGI
Bangalore, India
10 2023 - 02 2025
  • Project 1: AI Advisor Assistant (InsurTech Chatbot)
  • Tech Stack: Gen AI, Python, Selenium, RAGAS, Pytest, REST API, Requests, and Jenkins.
  • Description: Validated AI-powered advisor assistant chatbot designed to assist users with insurance processes.
  • Developed automated API and conversational tests for insurance advisory chatbot, covering context retention, incorrect prompts, missing information, adversarial inputs, and multi-turn conversations.
  • Created golden evaluation dataset containing more than 25 insurance scenarios and automated faithfulness, relevance, and context-quality measurements using Ragas.
  • Identified more than 12 high-severity hallucination and prompt-guardrail defects before release by combining deterministic business-rule assertions with semantic evaluation.
  • Project 2: OP Valu Finance (Guidewire Integration)
  • Tech Stack: Guidewire, Python, Selenium, Robot Framework, Jenkins, Kubernetes, Docker, and AWS.
  • Description: Performed automation testing for Guidewire Claim Center supporting OP Valu Finance business processes.
  • Automated ClaimCenter workflows using Python, Selenium, and Robot Framework, covering claim creation, policy verification, and integration flows.
  • Integrated regression execution with Jenkins and Docker and reduced execution time from 4 days to 1 day through parallelization.
  • Investigated failed executions, separated product defects from automation failures, and reduced flaky test rate from 15% to 3%.
  • Improved software quality by implementing advanced test automation strategies.

Test Automation Engineer

Mphasis
Bangalore, India
09 2019 - 09 2023
  • Project: FedEx to TNT End-to-End Integration (Logistics Migration)
  • Tech Stack: Java, Selenium, TestNG, Rest Assured, REST API, MySQL, and Jenkins CI/CD.
  • Description: Led end-to-end integration testing for FedEx Express and TNT logistics applications during large-scale system migration and integration phase.
  • Led end-to-end integration testing workflows utilizing TestNG and Rest Assured to validate high-throughput REST APIs handling cross-border logistics data.
  • Built scalable Java and Selenium framework from scratch to validate enterprise-level UI migration consistency between legacy TNT and FedEx target states.
  • Integrated daily smoke and sanitization suites into Jenkins to validate more than 120 critical logistics scenarios before deployment.

Education

Bachelor of Technology - Computer Science And Engineering

SRM University
Chennai, Tamilnadu, India
07/2015 - 06/2019

PG Diploma - Data Science

IIITB
Bangalore, Karnataka, India
01/2023 - 01/2024

Skills

  • Languages: Python, Java, SQL
  • Test Automation: Pytest, Selenium WebDriver, Robot Framework, TestNG, REST Assured
  • API and Data Testing: Python Requests, REST APIs, JSON Schema Validation, OAuth 20, MySQL
  • AI Quality Engineering: RAG validation, DeepEval, Ragas, golden datasets, faithfulness, answer relevance, hallucination testing, context precision, context recall, algorithm bias audit, toxicity, guardrail testing, LLM red teaming, F1 score
  • CI/CD and Infrastructure: Jenkins, Git, Docker, Kubernetes, AWS
  • Quality Engineering: Test strategy, test planning, exploratory testing, risk-based testing, integration testing, regression testing, RCA, code reviews, quality metrics
  • Design: OOP, SOLID principles, design patterns, Page Object Model

Certification

  • Guidewire Associate Quality Analyst
  • Certification in Core Java

ACHIEVEMENTS

Team Excellence Award (2026) – Happiest Minds Technologies

Languages

English
Master or proficient
C2
Hindi
Master or proficient
C2

Work availability

Monday
Tuesday
Wednesday
Thursday
Friday
Saturday
Sunday
morning
afternoon
evening
swipe to browse

Timeline

PG Diploma - Data Science

IIITB
01/2023 - 01/2024

Bachelor of Technology - Computer Science And Engineering

SRM University
07/2015 - 06/2019

Test Automation Engineer

Mphasis
09 2019 - 09 2023

Test Automation Engineer

CGI
10 2023 - 02 2025

Senior Test Automation Engineer

Happiest Minds and Technologies Pvt Ltd
02 2025 - 08.2026

Similar Profiles

Create profile
Faraz Khan