Additional Information
Joining Razer will place you on a global mission to revolutionize the way the world games. Razer is a place to do great work , offering you the opportunity to make an impact globally while working across a global team located across 5 continents. Razer is also a great place to work, providing you the unique, gamer-centric #LifeAtRazer experience that will put you in an accelerated growth, both personally and professionally.
Job Responsibilities :
We are hiring a Senior / Lead Software Engineer to design and build an AI/ML platform capable of high-throughput training and inference across local and cloud GPU environments. This role focuses on systems architecture, GPU acceleration, performance engineering, and reliable operation of AI workloads at scale. You will lead engineering initiatives, define platform architecture, and collaborate closely with ML and hardware teams. Responsibilities
System Architecture & Core Engineering
Design and implement the architecture for model training, fine-tuning, and serving.
Build platform components that support heterogeneous compute environments (GPUs, NPUs, accelerators).
Develop and optimize high-performance inference stacks using frameworks such as vLLM, SGLang, TensorRT-LLM, or Triton.
Develop APIs, CLI tools, and backend services for model lifecycle management.
Local & Cloud GPU Acceleration
Build and operate GPU clusters in on-prem systems and cloud environments (e.g., AWS/GCP/Azure).
Optimize GPU memory, compute throughput, PCIe/NVLink utilization, and inter-node communication for distributed inferencing & training.
Tune CUDA, cuDNN, NCCL, and related libraries for performance and reliability.
Deploy scalable GPU-based inference systems with attention to latency, throughput, and cost.
Collaboration & Leadership
Mentor engineers; drive design reviews, architecture discussions, and coding standards.
Work with ML researchers and hardware teams to co-design efficient algorithms and deployment strategies.
Coordinate engineering deliverables and provide clear technical direction for the team.
Pre-Requisites :
Required Skills & Experience
8+ years of experience in software engineering, ML infrastructure, or high-performance computing.
Hands-on experience designing and operating both local GPU servers and cloud GPU environments.
Deep knowledge of transformer-based model inference and training optimization.
Experience building high-availability distributed systems, including failover, replication, and autoscaling patterns.
Strong proficiency in Python and at least one systems language (C++ or Go).
Experience with deep learning frameworks (PyTorch, TensorFlow) and inference engines (vLLM, SGLang, TensorRT, Triton).
Solid understanding of distributed systems, parallel computing, and container orchestration (Docker, Kubernetes).
Solid understanding of GPU programming (CUDA or ROCm), GPU memory hierarchy, and performance tuning.
Strong collaboration and communication skills; ability to lead engineering efforts.
Razer · Singapore