Senior Software Engineer II - Applied AI (Remote Eligible)

About the role

The AI Platform Engineering team is looking for a highly motivated and talented engineer who are passionate about continuous learning and excited to grow in a fast-paced, innovative environment. We are an agile team that operates iteratively, focused on building high-quality software and adhering to rigorous operational best practices across complex, cross-functional distributed systems. This full-time position reports to a Software Engineering Manager and can be located in our Bellevue, WA office, or you may work remotely from anywhere in the US where Smartsheet is a registered employer.

Responsibilities

• Drive technical strategy : Partner with principal engineers to define the technical roadmap for Smartsheet's AI infrastructure, making architectural decisions that will shape how we build with AI for years to come.

Requirements

• Required
• 8+ years of software engineering experience, with at least 2 years working directly with LLMs in production
• Deep, hands-on experience with prompt engineering and context engineering, you understand how model behavior changes with framing, structure, and input design
• Strong working knowledge of RAG architectures: chunking strategies, embedding models, retrieval evaluation, and failure diagnosis
• Experience building or extending LLM evaluation frameworks, you have designed scorers, worked with golden datasets, and thought carefully about what good looks like
• Strong Python skills; comfortable working in data-heavy environments (Databricks, Delta tables, or equivalent)
• Ability to communicate complex quality findings (written and verbal) to both technical and non-technical stakeholders, you can explain what's broke, why it matters, and what needs to happen next without losing the room
• Strong cross-functional judgment, you know when to escalate, when to resolve independently, and how to build credibility across engineering, product, and AI platform teams
• A bias for clarity in ambiguous situations, when failure modes are murky and trade-offs are real, you bring structure and a clear point of view rather than waiting for consensus
• Strong Plus
• Prior work in an Applied AI or LLMOps platform within a product company
• Experience with the following:
• Kubernetes (EKS/GKE): The industry standard for AI. Skills include managing GPU scheduling, auto-scaling based on token throughput, and using tools like Karpenter for cost-efficient node provisioning.
• Infrastructure as Code (IaC): Using Terraform, Pulumi, or AWS CDK to provision Vector Databases, SQS queues, and S3 buckets.
• Vector Databases: Proficiency in managing and optimizing Pinecone, Milvus, Weaviate, or Databricks Vector Search .
• AI Gateways: Building or configuring proxies (like LiteLLM or Kong AI Gateway ) to handle rate-limiting, PII masking, and cost-tracking.
• LLM Observability: Setting up tracing tools like Langfuse, LangSmith, or MLflow to monitor "Time to First Token" (TTFT) and trace hallucination issues.
• Model-Based Evals: Implementing automated scoring systems (like RAGAS or DeepEval ) that use an "LLM-as-a-Judge" to grade production outputs.
• Current US Perks & Benefits:
• Employer subsidized medical/vision and dental coverage for full-time employees
• 401k Match to help you save for your future (50% of your contribution up to the first 6% of your eligible pay)
• Monthly stipend to support your work and productivity
• Flexible Time Away Program, plus Sick Time Off
• US employees are automatically cov

Benefits

Additional Information

For over 20 years, Smartsheet has helped people and teams achieve-well, anything. From seamless work management to smart, scalable solutions, we've always worked with flow. We're building tools that empower teams to automate the manual, uncover insights, and scale smarter. But more than that, we're creating space- space to think big, take action, and unlock the kind of work that truly matters. Because when challenge meets purpose, and passion turns into progress, that's magic at work, and it's what we show up for everyday.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Smartsheet? Share your experience