Sr. Manager, Software Development, AWS Mantle

About the role

The AWS Mantle team is building the next-generation inference engine that powers Amazon Bedrock-providing secure, enterprise-grade access to high-performing foundation models from the world's leading AI companies. Our mission is to simplify and accelerate how models are served at global scale, with an unwavering commitment to customer trust through innovations like our Zero Operator Access architecture, designed so that no person-whether from AWS, a customer, or a model provider-can ever access customer inference data. - We operate at massive scale, serving inference requests across all major AWS regions with sophisticated automated capacity management and unified resource pools - Our team values builders who thrive in ambiguity, think long-term, and are excited to define the future of AI infrastructure from the ground up - We foster a collaborative, inclusive environment where diverse perspectives drive better solutions-and where the best ideas win regardless of where they originate - We ship fast and iterate with purpose, having rapidly expanded from launch to supporting models from OpenAI, DeepSeek, Google, Mistral, NVIDIA, and more - We believe work should be meaningful and fun-you'll join a team that takes pride in making history at the forefront of generative AI

Requirements

• 10+ years of engineering experience
• 5+ years of engineering team management experience
• 10+ years of planning, designing, developing and delivering consumer software experience
• Experience partnering with product or program management teams
• Experience delivering results for large, cross-functional initiatives/projects
• Experience hiring, developing and promoting engineering talent
• Experience in written and verbal communication skills to communicate with technical and non-technical audiences, including senior leadership
• Experience partnering with product and program management teams
• Master's degree in computer science, computer engineering, or related field, or PhD
• Experience with training and deploying machine learning systems to solve large-scale optimizations, or experience operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets
• Experience with design, implementation, support,

Additional Information

Are you a proven engineering leader who thrives at the intersection of people development, technical strategy, and operational excellence? We are looking for a Senior Manager, Software Development to lead multiple engineering teams building AWS Mantle-the next-generation distributed inference engine that powers Amazon Bedrock. In this role, you will own a multi-year technical and organizational strategy, build and develop high-performing engineering teams, and drive the delivery of globally distributed AI infrastructure that serves millions of customers. You will operate independently in a space where the business opportunity and technology strategy are still being defined, shaping both as you go. - Own the organizational strategy and multi-year technical roadmap for multiple engineering teams building Mantle's inference platform - Build, hire, mentor, and develop engineering leaders and senior engineers-creating a sustainable culture of innovation and engineering excellence - Drive delivery of complex, cross-organizational programs that span distributed systems, ML infrastructure, and security - Define and execute on staffing, resourcing, and team structure decisions that align engineering capacity with business priorities - Serve as a visible leader across Amazon Bedrock, partnering with Directors, Principal Engineers, and product leaders to shape the future of AI inference at AWS Key job responsibilities As a Senior Manager, Software Development on the Mantle team, you will lead multiple two-pizza teams delivering mission-critical AI infrastructure at global scale. You will set the engineering culture, drive operational rigor, and balance short-term delivery with long-term strategic investments-all while growing the next generation of engineering leaders on your team. - Lead and manage multiple software development teams (including managing other managers) responsible for core Mantle subsystems such as capacity management, model onboarding, inference routing, and Zero Operator Access security - Define the long-term resource and staffing plan for your organization, making hiring, team structure, and succession planning decisions that support sustainable growth - Set and balance goals across your teams to optimize for customer outcomes, engineering quality, and employee development - Drive operational excellence across your portfolio-establishing mechanisms for monitoring, alarming, incident response, and continuous improvement at organizational scale - Partner with Principal Engineers, Applied Scientists, and cross-functional stakeholders to align technical architecture decisions with business strategy and product roadmaps

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Amazon Web Services, Inc.? Share your experience