Skip to main content
Back to jobs

Lead Software Engineer in Test - Agentic AI (Remote - US)

External
Nextech logoNextech · Worldwide
Full-timeRemoteToday
ComplianceHIPAA
Cover LetterConnect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

Requirements

  • Bachelor's degree in Computer Science, MIS, Engineering, or a related technical field.
  • 8+ years of experience in Software Development or Software Engineer in Test (SDET/SET) roles.5+ years of hands-on experience developing automation frameworks using JavaScript/TypeScript or Java.
  • Strong experience with automation tools such as Playwright, Cypress, Postman, K6, or equivalent frameworks.2+ years of experience testing AI-powered applications, LLM systems, Agentic AI platforms, orchestration frameworks, or autonomous workflows.
  • Hands-on experience validating agent orchestration workflows, conversational AI applications, multi-step reasoning systems, and AI-driven business processes.
  • Experience testing AI orchestration frameworks such as LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar technologies.
  • Strong expertise in API testing, backend integration testing, UI automation, and end-to-end workflow validation.
  • Solid understanding of automation architecture, design patterns, anti-patterns, dependency injection, and inversion of control principles.
  • Experience working in cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).Proven experience integrating automated test suites into CI/CD pipelines and distributed cloud environments.
  • Experience validating asynchronous, event-driven, and distributed systems with a focus on resiliency and fault tolerance.
  • Strong analytical, debugging, troubleshooting, and problem-solving skills.
  • Excellent organizational, communication, and stakeholder collaboration skills in Agile environments.
  • Experience with AI observability, telemetry, RAG pipeline validation, vector databases, or prompt evaluation frameworks (preferred).

Benefits

Generous annual bonus opportunity401(k) with Employer MatchFlexible Time Off: take time off when you need it without worrying about available hours11 paid holidaysYour Day Your Way - Celebrate a day of cultural or social significance to youInsurance: Choice of Medical, Dental, and Vision plansHealth Savings Account with employer matchFlexible Spending Account100% Company-Paid Parental leave (After 6 months with the company)100% Company-Paid Life Insurance and Short/Long Term Disability InsuranceNextech Luminary Peer Recognition ProgramWellness Program including discounts on medical premiumsEmployee Assistance Program with free counseling sessions availableCorporate Discounts on Retail, Travel, and Entertainment

Additional Information

Why join Nextech? We are a leader in specialty healthcare technology solutions. We're committed to hiring and retaining talent, which is why we invest in our employees through competitive pay, a generous bonus structure, great healthcare, a comprehensive wellness program, and many other benefits. If you are a software engineer, finance or accounting professional, customer support specialist, or a business development expert with a passion for healthcare technology (just to name a few), we want to hear from you. We are an equal opportunity employer with a commitment to diversity. All individuals, regardless of personal characteristics are encouraged to apply. If you are a candidate in need of assistance or an accommodation in the application process, please contact talent@nextech.com. Job Summary: The Lead Software Engineer in Test - Agentic AI is responsible for leading quality engineering strategy and execution across next-generation AI-powered applications and distributed systems. This role drives the design of scalable automation frameworks, validates complex AI agent behaviors, and ensures high-quality delivery across UI, API, backend, and AI orchestration layers. All activities must be performed in compliance with Equal Employment Opportunity (EEO) laws, HIPAA, ERISA, and all other applicable regulations.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Nextech? Share your experience

Interested in this role?

Apply on the company's website.

Cover LetterConnect