Machine Learning Engineer (MLOps), Evaluation

About the role

The team is a growing group that works closely with product, ML research, Data Science and infrastructure teams, to ensure the successful delivery of Apple Foundation models and Apple Intelligence evaluations. We are looking for a Machine Learning Engineer focusing on MLOps/LLMOps infrastructure to build a next generation LLM-powered evaluation systems. In this role, you will be instrumental in scaling our internal evaluation platform, building automation and self-service tools, and ensuring the reliability and efficiency of large-scale LLM services. You will have the opportunity to create huge impacts across all AI products through innovations.

Responsibilities

• Explore, design and implement advanced ML Infrastructure framework and tools.
• Establish standard methodologies for model integration, deployment, and monitoring using CI/CD principles.
• Ensure LLM services are scalable, efficient, and secure for high-traffic LLM services.
• Champion model observability, incident response, prompt versioning, and feedback loops.
• Use your ingenuity and creativity to resolve complicated and/or novel product and engineering challe
• Implement processes and frameworks for the continuous quality improvement of Apple Intelligence, fostering excellence and reliability.
• Work closely with data scientists, frontend engineers, product managers, and other stakeholders to define metrics, gather requirements, and deliver impactful solutions.

Requirements

• Hands-on experience with observability and evaluation tools for LLMs.
• Solid understanding of machine learning algorithms, model evaluation metrics, and data processing pipelines.
• Previous experience in a high-growth tech company or similar environment.
• Active participation in open-source projects related to AI/ML or backend development.
• Master or Ph.D. in a related field.
• 4+ years in software engineering with experience in large-scale software system design and implementation.
• Proven track record of shipping production-grade ML/LLM systems.
• Strong understanding of LLMs, fine-tuning, prompt engineering, vector databases and RAG patterns.
• Experience with distributed systems, databases (SQL/NoSQL), cloud platforms (AWS, Azure, GCP) and container orchestration (Kubernetes).
• Ability to tackle complex challenges, think critically, and deliver innovative solutions.
• Excellent communication skills and a team-oriented attitude, thriving in a collaborative and fast-paced environment.
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Pay & Benefits
• Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Additional Information

We are seeking a highly experienced Machine Learning Engineer to build, deploy, and optimize Large Language Model (LLM)-based applications, with a strong emphasis on MLOps/LLMOps (LLM operations) and scalable production systems. At Apple, we believe in creating technology that enriches lives and empowers creativity. You'll play a pivotal role in developing Apple Intelligence, driving the next generation of groundbreaking products across all Apple platforms.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Apple? Share your experience