Principal Data Engineer, LLM/AI Platforms (Remote)

External

Crowdstrike · Remote

Full-timeRemoteToday

AirflowAWSBigQueryData ModelingData WarehousingDevSecOps

Cover Letter Connect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role

About the role

CrowdStrike is looking for a Principal Data Engineer with deep expertise in Large Language Models (LLMs) and AI platforms to join our growing Data Science Platform Engineering Team. You will be a key leader, responsible for designing, building, and deploying cutting-edge data infrastructure that powers our next generation of AI-driven security products. This role requires significant hands-on experience in LLM integration, agentic workflows, and agent harnessing to deliver high-impact, scalable solutions. You will champion engineering excellence, focusing on shipping fast, writing elegant, high-quality code, and actively mentoring and strengthening the team's technical knowledge and capabilities. The scale of our systems and data are approaching Exabytes in size. Experience with extremely large-scale systems, including DevSecOps patterns, practices, and standards are important for this work.

Responsibilities

Architect, implement, and optimize data platforms and pipelines specifically designed to support LLMs, Retrieval-Augmented Generation (RAG), and sophisticated AI agentic systems at Exabyte scale.

Drive the adoption and deployment of agentic workflows and agent harnessing techniques to create autonomous, data-driven security features.

Design and implement highly scalable, fault-tolerant, and cost-effective data solutions, emphasizing rapid iteration and high-quality deployment.

Write elegant, production-ready code with a focus on performance, maintainability, and testing rigor, ensuring the ability to ship fast without compromising quality.

Provide technical leadership and deep expertise in data modeling, normalization, and semantic cataloging for AI/ML workloads.

Establish best practices for MLOps/DataOps surrounding LLMs, including monitoring, observability, and zero-touch recovery mechanisms for AI services.

Actively mentor engineers, conducting technical workshops, leading design reviews, and strengthening the team's knowledge in cutting-edge AI platform technologies.

Collaborate across the organization with Data Scientists, Product Managers, and other engineering teams to transform research prototypes into robust, production-grade services.

Own the end-to-end lifecycle of critical data services: development, testing, deployment, and monitoring.

Tech Stack (Expertise in several key areas is expected):

MLOps Tools (MLflow, Sagemaker, Vertex AI)

Experience with common agentic workflow frameworks (e.g., LangChain, LlamaIndex).

Expert-level proficiency in a high-level coding language (Python, or JVM technologies).

Deep experience with distributed data processing frameworks (e.g., Spark, Dask, Flink).

Strong expertise with cloud platforms (AWS, GCP, or OCI) and related data services.

Containerization and orchestration mastery (Docker, Kubernetes).

Message queuing and streaming technologies (Kafka, Pulsar).

Data Warehousing (Snowflake, BigQuery) and Data Orchestration (Airflow, Kubeflow).

Principal Data Engineer, LLM/AI Platforms (Remote)

About the role

Responsibilities

Requirements

Benefits

Additional Information

Your Match

Company Intel

What employees say

Interested in this role?