Skip to main content
Back to jobs

QA Automation Engineer (AI Systems & Web Apps)

External
talkspace logoTalkspace · NY
Full-timeHybrid2w ago
CI/CDCypressLessPlaywrightSeleniumSQL
Cover LetterConnect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

Responsibilities

  • Automation Testing
  • Develop and maintain automated test scripts for web apps, mobile apps, APIs, and LLM-driven features.
  • Build and improve automation frameworks for testing agentic and multi-step workflows.
  • Update automated scripts based on evolving requirements, prompts, tools, and system behaviors.
  • Debug and troubleshoot automation issues to ensure stability and reliability.
  • Manual & Exploratory Testing
  • Execute manual test cases to validate new features and identify defects.
  • Conduct exploratory testing to uncover unexpected behaviors, including AI-specific issues.
  • Create and maintain detailed test plans and test cases.
  • Document and track defects using standard tools and processes.
  • AI-Specific QA Responsibilities
  • Develop evaluation harnesses for LLM outputs, including structured output validation and model regression testing.
  • Collaborate with engineering and data science to validate safety layers and fallback mechanisms.
  • Identify gaps in test coverage for agentic workflows and propose improvements.
  • Team Collaboration
  • Work closely with engineers, QA peers, and product managers to design effective test strategies.
  • Communicate issues clearly and contribute to release readiness processes.
  • Participate in continuous improvement efforts to increase QA efficiency.
  • About You
  • BA/BS in Computer Science or related field
  • 3+ years of QA automation experience.
  • Experience with Cypress, Playwright, Selenium, or similar frameworks.
  • Experience testing AI/LLM-driven systems strongly preferred.
  • Experience with SQL, API testing, and JSON.
  • Familiarity with CI/CD pipelines and debugging automation failures.

Benefits

Comprehensive Medical, Dental and Vision plans coverage since day onePre-tax benefits: HSA/ FSA401k Retirement Savings Program with matching up to 4%Voluntary benefits including disability, basic life or pet insurance, etc.Monthly Wellness Stipend to promote mental and physical self-careFlexible PTO and Remote First EnvironmentRegular team events, including Wellness Workshops and Team Building EventsFree access to Talkspace products for you and one household member, as well as access to a friends and family discount!At Talkspace, we believe that pay transparency during the interview process is a critical part of diversity, equity, and inclusion. Our salary bands are based on internal and external compensation benchmarks, which we regularly evaluate to ensure we pay competitively.The base salary range for this role is between $85,000 and $155,000. Within the salary bands, leveling corresponds to each candidate's relevant experience, skills as assessed during the interview process, education, and applicable certifications.Why Talkspace?Health insuranceDental insuranceVision insurance401(k)Paid time offRemote work optionsFlexible scheduleEquity / stock options

Additional Information

At Talkspace, we are committed to fostering a diverse, equitable, inclusive, and belonging-centered workplace where everyone can thrive while making a difference in mental health. Want to help over two million people receive quality mental healthcare? Come join our mission of getting therapy in the hands of everyone! Our engineering team is looking for a QA Automation Engineer. This role will be responsible for building and maintaining automated and manual testing frameworks that ensure the reliability, safety, and performance of web, mobile, API, and LLM-powered systems. This role includes designing tests for agentic workflows, validating structured outputs, identifying regressions in model behavior, and collaborating with engineers and product managers to ensure comprehensive test coverage. Talkspace HQ is in NYC; this position is based in Eastern Standard Time.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at talkspace? Share your experience

Interested in this role?

Apply on the company's website.

Cover LetterConnect