Senior Data Platform Engineer

About the role

Pinecone is looking for a Senior Data Engineer to own and grow the systems that power how we understand our business. You will design and operate the ingest, transform, orchestration, and metrics layers that feed analysts, executives, and the Board, and you will lead the analyses themselves when the question matters enough. This is a high-ownership role on a small team, with direct exposure to finance, GTM, product, and the executive staff.

Responsibilities

• Own and build the ingestion layer. Design, deploy, and scale pipelines that pull from third-party APIs, internal services, and SaaS tools into BigQuery. Add new sources as the business demands.
• Own and build the transform layer. Develop and maintain our DBT project, including staging, intermediate, and marts. Maintain core business datasets: users, organizations, indexes, accounts, usage, revenue. Write tests, snapshots, and documentation. Drive data quality and trust.
• Own and build the orchestration platform. Operate the Airflow-on-Kubernetes environment that runs our ingest and DBT workloads. Improve reliability, scalability, observability, and CI/CD.
• Establish and maintain the business-context and metrics layer. Curate metric definitions and documentation that feed both human analysts and agents.
• Manage infrastructure cost and performance. Manage BigQuery, GKE, Cloud Run, and Kafka costs, right-size compute, and make sure the platform stays efficient.
• Enable other teams to self-serve. Onboard analysts and non-DE stakeholders onto the warehouse, help them with best practices, and create reusable models and tooling.
• Set the standard for AI-assisted data workflow. Establish best AI practices and patterns that enable a small data team to operate with outsized leverage.

Requirements

• 4+ years building and operating data pipelines in production.
• Strong SQL, with comfort in BigQuery (or Snowflake/Redshift) writing non-trivial analytical queries, optimizing performance, and reasoning about correctness.
• Strong coding skills, with comfort writing ETL/rETL, consuming services and integrations against REST/GraphQL APIs, and producing clean code that others can reuse and maintain.
• Experience with a modern orchestrator (Airflow, Dagster, Prefect, or similar) running containerized workloads.
• Comfort with Docker, Kubernetes, and modern cloud infrastructure best practices.
• Experience integrating systems, pulling data between APIs, databases, and warehouses; handling auth, pagination, schema drift, and incremental loads.
• Hands-on experience using AI coding tools (Claude Code, Cursor, or similar) as part of your workflow.
• Ability to design, build, and own systems end-to-end in a highly autonomous environment.
• Production DBT experience: layered models, tests, snapshots, macros, deferred builds.
• Experience working with a semantic layer, metrics layer (DBT Semantic Layer, Cube, LookML).
• Comfortable with exploratory analysis, designing experiments and A/B tests, basic statistical modeling, and separating signal from noise in messy data.
• Exposure to building AI agents or applications.
• Infrastructure-as-code (Terraform, Pulumi, or similar).

Benefits

Additional Information

About Pinecone Pinecone is the leading vector database for building accurate and performant AI applications at scale in production. Pinecone's mission is to make AI knowledgeable. More than 9000 customers across various industries have shipped AI applications faster and more confidently with Pinecone's developer-friendly technology. Pinecone is based in New York and raised $138M in funding from Andreessen Horowitz, ICONIQ, Menlo Ventures, and Wing Venture Capital.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at pinecone? Share your experience