Member of Technical Staff - ML Infrastructure & Performance
External
Embedding-vc · San Mateo, CAPrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
About the role
Introducing Moonlake, AI for creating real-time interactive content Mission: Improve Throughput, Latency, & Cost - deploying our models 2-10× faster & cheaper without quality regressions. Scope of Work: - GPU performance: CUDA/Triton kernels, FlashAttention family, paged attention, CUDA Graphs. - Serving stack: TensorRT-LLM/Triton Inference Server, vLLM/TGI; continuous batching; on-GPU KV reuse; speculative decoding/medusa; mixture-of-agents routing. - Parallelism: FSDP/ZeRO, TP/PP/expert parallel; NCCL tuning. - Quantization/PEFT: AWQ/GPTQ/FP8; LoRA/DoRA serving. - Systems: Ray/k8s/Argo, observability (Prom/Grafana/OpenTelemetry), autoscaling, A/B infra, canary + rollback. Tech signals: Previous experience at Infra-heavy startups such as Databricks, Roblox We are committed to being an on-site, in-person team currently based in San Mateo
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at embedding-vc? Share your experience