Senior/Principal Engineer (m/f/x) for Evaluations Generative AI
External
Dynatrace · Boston, MA$74K–$112K/yrFull-timeRemoteToday
iOS
Prepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
About the role
Design and build evaluation and simulation systems for generative AI agents using Dynatrace observability data. Create large-scale simulation pipelines, define metrics/datasets/judging strategies, build developer CLIs, generate adversarial scenarios, and measure agent tool-use and failure modes. Prototype, run feedback cycles, set technical strategy, and mentor engineers.
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at Dynatrace? Share your experience