Principal AI/ML System Software Engineer

Requirements

• Minimum:
• BS in Computer Science, Engineering, Math, Physics, or related degree with 12+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics, or related degree preferred with 6+ years
• Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
• Proficient in C/C++/Python development in Linux environment and using standard development tools
• Experience with distributed, high-performance software design and implementation
• Self-motivated team player with a strong sense of ownership and leadership.
• Preferred:
• MS or PhD in Computer Science, Electrical Engineering, or related fields
• Experience with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
• Experience with deep learning frameworks (such as PyTorch and TensorFlow)
• Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.).
• Experience with distributed systems collectives such as NCCL and OpenMPI
• Experience with software testing fundamentals
• Experience deploying ML workloads (LLMs, VLMs, NLP, etc.) on distributed systems.
• Experience with Kubernetes, Ray, or other MLOps tools and techniques used from definition to deployment
• Prior startup, small team, or incubation experience
• Work experience at a cloud provider or AI compute/subsystem company
• Equal Opportunity Employment Policy

Additional Information

At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration. We value humility and believe in direct communication. Our team is inclusive , and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together , we can help shape the endless possibilities of AI. Location: Hybrid, working onsite at our Santa Clara, CA, headquarters 3 days per week. The role: Principal AI/ML System Software Engineer

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at d-matrix? Share your experience