Senior Software Engineer II(Go,AI)

Responsibilities

• Design and scale the core Orchestrator using Go, managing the global state, session lifecycles, and rapid allocation of sandboxes for millions of user requests.
• Design and implement robust multi-tenant API Gateways and authentication layers to securely isolate customer workloads, rate-limit abuse, and track usage for billing.
• Build high-performance routing proxies (HTTP/WebSocket/gRPC) capable of instantly tunneling traffic from external client SDKs directly to internal service endpoints.
• Manage complex state synchronization and service discovery patterns using tools like Consul, Nomad, or Kubernetes to ensure high availability across distributed clusters.
• Own the developer interface , optimizing how the control plane surfaces real-time execution telemetry, structured logging pipelines, and file streaming back to the user's application.
• Key Metrics
• Control Plane API Latency: Maintain sub-20ms overhead for API authentication, routing, and command dispatching.
• System Uptime & Reliability: Target a 99.99% uptime SLA for the control plane API and proxy layers.
• Multi-Tenant Isolation: Ensure zero cross-tenant data leaks or unauthorized API access at the control plane level.
• Token/Session Handover Time: Minimize the time it takes from a user requesting a sandbox to the control plane establishing a secure proxy tunnel.
• What You'll Add to DigitalOcean
• Distributed Systems Mastery: 8+ years of professional software engineering experience, with a heavy emphasis on building large-scale SaaS or PaaS control products using Go (Golang) or similar backend languages.
• API & Proxy Expertise: Proven experience building high-throughput REST/gRPC APIs, custom reverse proxies, or network routers handling concurrent connection scaling.
• Orchestration & State Management: Practical experience with cluster schedulers ( Nomad , Kubernetes), service meshes, or distributed key-value stores ( Consul , Etcd) for real-time state tracking.
• Data Layer Architecture: Strong experience modeling application state in PostgreSQL and designing high-volume telemetry ingestion pipelines using columnar data stores like ClickHouse .
• Product-First Mindset: Experience building products designed for other developers (APIs, SDKs, Cloud Consoles) with a deep empathy for developer workflows and latency constraints.
• Preferred Attributes: Familiarity with the unique orchestration challenges of Agentic AI, LLM orchestration frameworks, or building multi-tenant user platforms.
• *This job is located in Hyderabad, India
• #LI-Hybrid
• Why You'll Like Working for DigitalOcean
• We care about your well-being. Regardless of your location, we will provide you with

Benefits

Additional Information

Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you'll find your place here. We value winning together-while learning, having fun, and making a profound difference for the dreamers and builders in the world. We are looking for a Senior Software Engineer II (IC4) who is passionate about distributed systems orchestration , high-throughput API design, and building the multi-tenant control plane that powers Agentic AI applications. As a Senior Software Engineer II (IC4) at DigitalOcean, you will join a dynamic engineering team dedicated to revolutionizing cloud computing and AI. In this role, you will report directly to the Engineering Manager of the Sandbox Team. You will act as the technical anchor for the squad responsible for the entire management tier, user lifecycle, and API orchestration of our sandbox platform. You will design and develop the "brain" of the product, interfacing directly with developer SDKs and coordinating with underlying internal virtualization services to deliver a seamless, secure, and scalable developer experience.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at digitalocean98? Share your experience