Principal/Staff HPC Network Engineer

About the role

GPU clusters are some of the most performant computers on the planet. Even smaller clusters by today's standards would have ranked in the TOP500 five years ago. Our infrastructure team is responsible for architecting and deploying new clusters around the world and keeping them running smoothly. You'll participate in on-call rotation, fix issues when they arise, and lean into automation to enable deployments at scale. We're a small but ambitious team so you'll be an early contributor helping to shape culture, mentor junior engineers, and learn from our customers. About You You will have 10+ years of experience with hands-on management or architecture with network for at least one GPU cluster in the past (ideally a cluster with >1k GPU's but not required) You deeply understand the fundamentals of Ethernet (RoCEv2) and/or InfiniBand networks in CLOS/fat-tree topologies You have built HPC network architectures (eBGP, fat-tree, VXLAN, MCLAG, etc.) The idea of implementing zero-touch provisioning for a large multi-layer network excites you (you embrace automation) You appreciate, value and generate good documentation You have the ability and willingness to mentor junior engineers You're open to coming in to our San Francisco office 3-4 days per week Some Nice to Haves You understand data center concepts including power, cooling and how to engage with colo providers You have experience with Linux systems administration including managing kernel drivers and tuning the network stack You have experience with Linux virtualization (KVM, QEMU, libvirt, etc.) You've had exposure to containers and Kubernetes operators