AI QA/Testing Lead

Requirements

• 8+ years of QA engineering experience, with at least 3 years in a lead or management role.
• Proven experience building QA teams and establishing testing processes from scratch.
• Experience testing AI/ML systems, APIs, or complex distributed platforms.
• Track record of implementing test automation frameworks at enterprise scale.
• Experience with agile/scrum development environments.
• Background in enterprise software, ERP systems, or B2B platforms preferred.
• Technical Skills
• Required
• Test automation frameworks: Pytest, Selenium, Playwright, or Cypress.
• API testing: Postman, REST Assured, or equivalent tools.
• API contract te

Benefits

Additional Information

About Rimini Street, Inc. Rimini Street, Inc. (Nasdaq: RMNI), a Russell 2000® Company, is a proven, trusted global provider of end-to-end, mission-critical enterprise software support, managed services and innovative Agentic AI ERP solutions, and is the leading third-party support provider for Oracle, SAP and VMware software. Our comprehensive portfolio of unified solutions help run, manage, support, customize, configure, connect, protect, monitor, and optimize enterprise application, database and technology software, enabling our clients to achieve better business outcomes, significantly reduce costs and reallocate resources towards strategic projects. The Company has signed thousands of contracts with Fortune Global 100, Fortune 500, midmarket, public sector and government organizations who selected Rimini Street as their trusted, proven mission-critical enterprise software solutions provider and achieved better operational outcomes, realized billions of US dollars in savings and funded AI and other innovation investments. We are seeking a QA Testing Lead - Agentic ERP Platform. This hybrid role is based in our Selangor or Penang office. Position Summary The QA Testing Lead owns the quality assurance strategy for Rimini Street's Agentic ERP Platform, establishing the testing frameworks, standards, and processes required to validate AI-driven systems in production. This role defines how the team ensures platform reliability, accuracy, and safety across non-deterministic agent behaviors-with a particular focus on proving the platform is trustworthy enough for SOX-regulated ERP environments. Reporting to the VP, Platform Engineering, this leader builds the QA function from the ground up-hiring and mentoring QA engineers, defining AI evaluation strategies with measurable accuracy thresholds, and establishing quality gates that balance rapid iteration with enterprise-grade reliability. The ideal candidate combines deep QA leadership experience with a strong understanding of how to test AI and ML-powered systems. Essential Duties & Responsibilities AI Evaluation Strategy & Quality Gates Own the AI evaluation strategy: define evaluation rubrics, accuracy thresholds, regression baselines, and gating criteria for agent behaviours. Establish testing frameworks and methodologies suited to non-deterministic AI agent outputs, including statistical validation approaches and LLM-as-judge evaluation patterns. Design quality gates for the CI/CD pipeline that enforce standards without blocking delivery velocity. Define and maintain test plans, test cases, and traceability matrices aligned to platform requirements. Own SOX-grade audit evidence validation-proving that every agent action produces a complete, immutable audit chain suitable for financial-controls-regulated client environments. Team Leadership Build and lead the QA engineering team for the Malaysia engineering team. Mentor QA engineers on testing methodologies for AI-powered systems. Establish team processes, code review standards for test automation, and knowledge sharing practices. Coordinate testing activities across distributed engineering teams in India, Malaysia, and Brazil. Test Automation & Infrastructure Drive test automation strategy, identifying high-value areas for automated coverage. Oversee the development of automated test suites for API, UI, and end-to-end testing. Design air-gap test environment strategy for validating releases destined for disconnected client environments where standard cloud test infrastructure does not apply. Establish and maintain test environments that replicate production configurations. Implement test data management strategies for complex enterprise scenarios. Quality Assurance Operations Own defect management processes, including triage, prioritization, and resolution tracking. Produce quality metrics and dashboards that provide visibility into platform health. Conduct root cause analysis on production issues and drive systemic improvements. Coordinate release validation activities and sign-off processes. Coordinate chaos engineering activities: failure injection on durable workflows, network partition simulation, and replay verification. Coordinate with platform engineering teams to validate that delivery teams use platform primitives correctly and adhere to established patterns.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at riministreet? Share your experience