Machine Learning Infrastructure Engineer Model Inference Jobs in San Francisco - Hiro
Browse 50+ Machine Learning Infrastructure Engineer Model Inference in San Francisco roles from companies hiring right now. Updated daily as new jobs land on Hiro. Salaries range from $0K to $0K based on listed pay.
50 Machine Learning Infrastructure Engineer Model Inference roles in San Francisco
Sorted by most recently posted.
Member of Technical Staff, Inference
Inferact · San Francisco
$200K–$400K/yr
Product Finance, Inference Capacity Lead
Anthropic · San Francisco, CA
$235K–$310K/yr
Staff+ Software Engineer, Inference Runtime
Anthropic · San Francisco, CA
Research Intern, Inference (Fall 2026)
Together Ai · San Francisco
Senior Data Scientist, Causal Inference
Lyft · San Francisco, CA
$148K–$185K/yr
Staff + Senior Software Engineer, Inference
Anthropic · San Francisco, CA
$320K–$485K/yr
Staff + Sr. Software Engineer, Cloud Inference
Anthropic · San Francisco, CA
$320K–$485K/yr
Software Engineer- BIS (Baseten Inference Stack)
Baseten · San Francisco
$180K–$360K/yr
Distributed Training and Inference Engineer
Sciforium · San Francisco
$190K–$250K/yr
Customer Support Engineer (Inference)
Together Ai · San Francisco, CA
Senior Engineer, Inference Data Plane
Digitalocean98 · San Francisco
$139K–$174K/yr
Senior Engineer II, AI Inference Engine Systems
Digitalocean98 · San Francisco
$167K–$209K/yr
Staff Technical Lead for Inference & ML Performance
Fal · San Francisco
Performance Engineer, Inference Systems
Anthropic · San Francisco, CA
Engineering Manager, Model Inference
Abridge · San Francisco
Solution Architect (AI/LLM Inference)
Baseten · San Francisco
Software Engineer, Productivity - Inference Runtime
Openai · San Francisco
$230K–$385K/yr
Staff + Sr. Software Engineer, Cloud Inference Launch Engineering
Anthropic · San Francisco, CA
$320K–$485K/yr
Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco
Plaud · San Francisco, CA
$200K–$540K/yr
Senior Backend Engineer, Inference Platform
Together Ai · San Francisco
$160K–$250K/yr
Machine Learning Engineer - Inference
Together Ai · San Francisco
$160K–$230K/yr
LLM Inference Frameworks and Optimization Engineer
Together Ai · San Francisco, Singapore
$160K–$230K/yr
Forward Deployed Engineer (Inference & Post-Training)
Together Ai · San Francisco
$270K–$300K/yr
Distributed Systems Engineer, Data & Inference Platform
Adaption · San Francisco
Staff + Sr. Software Engineer, Inference
Anthropic · San Francisco, CA
$300K–$485K/yr
Research Engineer, Infrastructure, Inference
Thinkingmachines · San Francisco
$350K–$475K/yr
Distributed LLM Inference Engineer
Anyscale · San Francisco
$170K–$247K/yr
Staff Software Engineer, Cloud Inference Safeguards
Anthropic · San Francisco, CA
Software Engineer, Inference Deployment
Anthropic · San Francisco, CA
$320K–$485K/yr
Engineering Manager, Inference Routing and Performance
Anthropic · San Francisco, CA
Lead Member of Technical Staff, Inference Infrastructure
Cohere · San Francisco
Technical Program Manager, Cloud Inference
Anthropic · San Francisco, CA
$290K–$435K/yr
Software Engineer, Inference - Performance Optimization
Openai · San Francisco
Software Engineer - Voice AI (Inference Runtime)
Baseten · San Francisco
$165K–$330K/yr
Applied AI Inference Engineer
Baseten · San Francisco
Engineering Manager (AI Inference)
Perplexity · San Francisco
Member of Technical Staff (AI Inference Engineer)
Perplexity · San Francisco
Staff Software Engineer - GenAI inference
Databricks · San Francisco, CA
$191K–$233K/yr
Software Engineer - GenAI inference
Databricks · San Francisco, CA
$142K–$205K/yr
Engineering Manager, Model Routing & Inference
Cursor · San Francisco
Technical Program Manager, Inference Performance
Anthropic · San Francisco, CA
$290K–$365K/yr
Engineering Manager, Inference
Anthropic · San Francisco, CA
$425K–$560K/yr
TL, Research Inference
Openai · San Francisco
$380K–$555K/yr
Inference Technical Lead, On-Device Transformers
Openai · San Francisco
$445K/yr
Member of Technical Staff - ML Systems & Inference
Gimlet · San Francisco
$150K–$350K/yr
Member of Technical Staff - Edge Inference Engineer
Liquid-ai · San Francisco
Member of Technical Staff, Inference
Inferact · San Francisco
$200K–$400K/yr
Staff Software Engineer, Inference Infrastructure
Cohere · San Francisco
Software Engineer, Inference - AMD GPU Enablement
Openai · San Francisco
Machine Learning Infrastructure Engineer- Model Inference
Abridge · San Francisco
$221K–$260K/yr
Explore more machine learning infrastructure engineer model inference roles
Tired of scrolling job boards?
Hiro scores every machine learning infrastructure engineer model inference role against your profile so you only see the ones that actually fit. Free to start.