Pranav Gupta
Noida / Remote
Summary
AI Quality Manager (Production and MLOps) - 14 Years
- Enterprise AI Quality Leader driving production-grade governance across AI/ML platforms.
- Established end-to-end AI validation frameworks ensuring reliability, fairness, compliance, and risk control.
- Integrated MLOps-aligned quality gates within CI/CD pipelines to safeguard model deployments.
- Governed LLM and predictive systems through structured monitoring, drift control, and executive reporting.
- Enabled scalable, automation-led quality transformation across complex enterprise environments.
Overview
15
15
years of professional experience
1
1
Certification
Work History
AI Quality manager and MLOps
GlobalLogic
05.2023 - Current
- Defined a Quality Framework for AI/ML-powered applications covering model validation, data integrity, and production monitoring.
- Established ML model testing strategy, including data drift detection, bias validation, accuracy benchmarking, and regression validation.
- Implemented CI-integrated model validation pipelines to ensure automated quality gates before deployment.
- Governed LLM-based application testing (prompt validation, response consistency, and hallucination risk checks).
- Designed production monitoring dashboards covering model accuracy, latency, and SLA adherence.
- Led defect triage for AI prediction failures and implemented structured RCA mechanisms.
- Ensured compliance with enterprise standards for explainability, auditability, and traceability.
- Integrated AI-driven test generation and flaky test detection into the automation lifecycle.
AI Test Lead
Nagarro Software
Gurgaon
11.2015 - 04.2023
- Defined a Quality Framework using Playwright for AI/ML-powered applications, covering model validation, data integrity, and production monitoring.
- Established ML model testing strategy, including data drift detection, F1 score, confusion matrix, bias validation, accuracy benchmarking, and regression validation.
- Implemented CI-integrated model validation pipelines to ensure automated quality gates before deployment.
- Governed LLM-based application testing (prompt validation, response consistency, and hallucination risk checks).
- Designed production monitoring dashboards covering model accuracy, latency, data drift, model drift, and SLA adherence.
- Led defect triage for AI prediction failures and implemented structured RCA mechanisms.
- Integrated AI-driven test generation and flaky test detection into the automation lifecycle.
- Defined a Quality Framework for AI/ML-powered applications covering model validation, data integrity, and production monitoring.
- Established ML Model Testing Strategy including data drift detection, bias validation, accuracy benchmarking, and regression validation.
- Implemented CI-integrated model validation pipelines, ensuring automated quality gates before deployment.
- Governed LLM-based application testing (prompt validation, response consistency, hallucination risk checks).
- Create monitoring metrics for data augmentation and HLP performance requirements.
- Designed production monitoring dashboards covering model accuracy, latency, and SLA adherence.
- Led defect triage for AI prediction failures and implemented structured RCA mechanisms.
- Ensured compliance with enterprise standards for explainability, auditability, and traceability.
- Integrated AI-driven test generation and flaky test detection into the automation lifecycle.
Sr. Test Automation Analyst
Fidelity Information Services
Gurgaon
12.2014 - 10.2015
- Defined an enterprise-wide QA automation strategy, aligning testing objectives.
- with business and product goals.
- Established an automation framework for Selenium using the Page Object Model.
- Resource planning, optimising automation investments, and reducing costs by up to 25%.
- Represented QA in executive-level discussions, influencing release planning.
- Product roadmaps for client meetings and stakeholders.
Business Analyst
EXL Services
06.2014 - 12.2014
- Gurgaon
Test Analyst
Tech Mahindra
04.2011 - 06.2014
- Pune
Education
B.Tech - Electronics & Communication Engineering
UPTU
01.2010
Skills
- Selenium Playwright BrowserStack
- Python JavaScript
- LangChainTensorFlow QA monitoring
- API testing
- Cucumber BDD Page Object Model (POM)
- Jenkins Github Docker
- AI-driven Test Generation
- Cursor
- Co-pilot Microsoft AI search
- Sleep healthTech
- E-commerce
- Internet of Things
- Machine learning
- Production monitoring
- Auditing expertise
- Test plan Test strategy
- Test rail Jira
- Risk-based testing
- Effort estimation
- Quality management
- Risk assessment
- Model validation
- Data integrity
Accomplishments
- Multiple 'Pat on the Back' & Client Appreciations for automation utilities & frameworks
- Awarded on 'Cheer Board' at Nagarro (2016, 2018) for outstanding contributions
- Developed Excel + Java automation utilities, saving hours of manual testing effort
Languages
English
Proficient
C2
Certification
ISTQB Certified Tester (CTFL)
License: ITB-CTFL-0083189
Interests
Startup Innovation Podcast
Exploring and travel
Music
Timeline
AI Quality manager and MLOps
GlobalLogic
05.2023 - Current
AI Test Lead
Nagarro Software
11.2015 - 04.2023
Sr. Test Automation Analyst
Fidelity Information Services
12.2014 - 10.2015
Business Analyst
EXL Services
06.2014 - 12.2014
Test Analyst
Tech Mahindra
04.2011 - 06.2014
B.Tech - Electronics & Communication Engineering
UPTU