Senior Performance Engineer - AI Platforms

About the role

The Red Hat Performance and Scale Engineering team is seeking a Senior Performance Engineer to join our PSAP (Performance and Scale for AI Platforms) team. In this role, you will drive the performance and scalability of distributed inference for Large Language Models (LLMs) as part of the Red Hat AI Inference Server (RHAIIS) open-source project. You will be responsible for characterizing, modeling, and understanding performance deltas to ensure industry-leading throughput, latency, and cost-efficiency of AI workloads. This includes using tools like vLLM, GuideLLM, and PyTorch for example.This is a dynamic role for a seasoned engineer with a growth mindset who handles and adapts to rapid change, has a strong commitment to open-source values, and the willingness to learn and apply new technologies. You will be joining a vibrant open source culture and helping promote performance and innovation in this Red Hat engineering team. The broader mission of the Performance and Scale team is to establish performance and scale leadership of the Red Hat product and cloud services portfolio. The scope includes component level, system and solution analysis and targeted enhancements. The team collaborates with engineering, product management, product marketing and customer support as well as Red Hat's hardware and software ecosystem partners.