Sr. Machine Learning Engineer

Responsibilities

• Asynchronous Systems: Architect and optimize high-throughput, event-driven systems using Apache Kafka to handle real-time data flows.
• Data Processing at Scale: Build and maintain large-scale data pipelines using Apache Spark or Flink to provide the high-volume analytics that power our AI.
• Agentic Systems at Scale: Design sophisticated AI Agents capable of autonomous planning, memory management, and high-reliability tool-use across distributed environments.
• Infrastructure & Orchestration: Lead the architectural design of containerized services on Kubernetes, ensuring high availability and scalability across Cloud Infrastructure (AWS/Azure/GCP).
• Your Toolkit:
• 5-8 years of experience in backend engineering using Java, Python, or Go.
• Expertise in distributed systems, asynchronous architectures (Kafka), and large-scale data processing (Spark/Flink).
• Hands on experience with agentic frameworks (e.g., AutoGen, CrewAI, or custom orchestration layers), RAG, MCP, fine tuning models and prompt engineering.
• Agentic observability using Langfuse, Evals frameworks for Testing/Resilience
• Bonus Points:
• Advanced IaC: Expertise in building reusable Terraform modules and managing complex multi-region cloud deployments.
• Vector DB Optimization: Deep experience in indexing strategies (HNSW vs IVF) and performance tuning for high-concurrency vector databases at scale.
• AI Ops: Experience with LLM deployment optimization (e.g., vLLM, TensorRT-LLM) or managing proprietary model inference endpoints.
• This position involves access to software/technology that is subject to U.S. export controls. Any job offer made will be contingent upon the applicant's capacity to serve in compliance with U.S. export controls #LI-TD1 #LI-ONSITE
• Our Commitment
• Illumio believes that an environment of unique backgrounds, experiences, viewpoints, and individual contributions creates a culture of belonging, drives our future, and makes us stronger together in support of our customers and their success.
• For roles in San Francisco and Los Angeles: Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Illumio will consider for employment qualified applicants with arrest and conviction records.

Benefits

Additional Information

Onwards Together! Illumio is the leader in ransomware and breach containment, redefining how organizations contain cyberattacks and enable operational resilience. Powered by the Illumio AI Security Graph, our breach containment platform identifies and contains threats across hybrid multi-cloud environments - stopping the spread of attacks before they become disasters. Recognized as a Leader in the Forrester Wave™ for Microsegmentation, Illumio enables Zero Trust, strengthening cyber resilience for the infrastructure, systems, and organizations that keep the world running. Our Team's Vision: Our Engineering team is shaping the future of cybersecurity. We thrive on visionary leadership, autonomy, and ownership, fostering a culture of innovation that propels us forward in the ever-evolving cybersecurity landscape. As a leader in Zero Trust Segmentation, we are redefining security for a world facing unprecedented cyber threats. You'll work with a highly scalable SaaS service built using cloud-native technologies while simultaneously shipping the solution on-premises. Our guiding philosophy in Engineering is to get things right through practicing disciplined engineering, focusing, not cutting corners, and of course having fun while we are at it. We believe in enabling ownership at all levels of the organization and empowering teams. If you thrive in this culture, come join us! As a Senior Software Engineer, you will architect high-scale distributed systems that process massive data volumes to fuel our Agentic AI ecosystem. You will lead the development of autonomous agents that don't just provide analytics, but take action-driving complex automation and insights for our enterprise customers.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at illumio? Share your experience