Senior AI Engineer

About the role

We're looking for a Senior AI Engineer to own the design, development, and continuous improvement of the AI agent systems that power modern research operations. This is a high-ownership, high-impact role at the intersection of applied ML and systems engineering. You'll work on hard problems - model reliability at scale, long-context handling, cascading error mitigation, and evaluation infrastructure - and you'll do it on a team that ships fast and takes quality seriously.

Responsibilities

• Data Creation and Intelligence
• Design and own synthetic data generation pipelines that improve model performance on edge cases
• Develop evaluation datasets for domain-specific languages (DSLs) to systematically identify and close model weaknesses
• Build and maintain automated data quality checks and large-scale research data pipelines
• Model Response Analysis and Monitoring
• Define structured rubrics for evaluating AI outputs on nuanced and ambiguous research tasks
• Build continuous monitoring, logging, and performance optimization systems for AI models in production
• Create tooling that enables domain experts to refine and evolve training datasets over time
• System Architecture and Scale
• Lead research and implementation of solutions for long-context handling and cascading error challenges in LLM pipelines
• Design and evaluate production-grade AI agent systems end-to-end
• Drive prompt engineering strategy and experimentation frameworks across the team

Requirements

• 4+ years of engineering experience, with at least 2 years focused on LLM systems or applied ML in production
• Deep hands-on experience with LLMs, synthetic data pipelines, evaluation frameworks, and AI system optimization
• Strong Python skills; Go or TypeScript a plus
• Solid understanding of prompt engineering, model fine-tuning, and evaluation methodology
• Experience building and operating production AI systems - not just prototypes
• Strong instincts for debugging complex, non-deterministic system failures
• High ownership: you drive problems to resolution independently and pull in others when needed
• Experience with model monitoring, bias evaluation, or dataset management tooling
• Background in semantic parsing, DSLs, or structured output models
• Prior work on agentic systems, multi-step reasoning pipelines, or tool-use frameworks
• Why Metaforms
• Work at the frontier of production AI - not demos, not experiments, but systems handling 1,000+ research projects a month
• Small, senior team where your decisions have real architectural impact
• Zero-bureaucracy culture: high autonomy, fast feedback loops, direct access to leadership
• Well-funded and financially stable, with a clear roadmap and the runway to execute on it

Benefits

Additional Information

About Metaforms Metaforms is redefining how market research gets done. Our AI platform empowers the world's leading research agencies to scale 10x faster while maintaining uncompromising quality. With AI Agents that augment survey programming, data processing, and project management, we help customers like Dynata, Savanta, and Borderless Access deliver more projects with less friction. 1,000+ surveys processed monthly Serving Fortune 500 companies across the globe Rapid month-over-month growth Series A funded and growing fast, we're aggressively scaling our AI engineering team to build the next generation of production-grade AI agent systems.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Metaforms? Share your experience