Design, build, and own real-time and batch data pipelines in Azure Databricks using Spark, Airflow, and modern orchestration and build tools.
Drive engineering excellence by implementing robust testing practices (unit, integration), code review standards, and CI/CD automation.
Implement automated data quality frameworks and validation of pipelines.
Build observability systems to monitor data integrity, drift, and system health. Troubleshoot complex data infrastructure and pipeline issues.
Design analytics-ready datasets that power business intelligence and operational reporting.
Partner with diverse stakeholders (including Data Scientists, Analysts, and ML Engineers) to define use cases and build robust data products.
Translate large datasets into actionable insights for leadership and product teams.
Explore emerging technologies including modern data platforms, distributed computing frameworks, build proof-of-concept solutions, and continuously improve platform scalability, performance, and cost efficiency
Requirements
6+ years' experience in building data pipelines, distributed systems, or large scale data platforms on major clouds (Azure preferred).
Strong software engineering fundamentals: design patterns, testing strategies (unit, integration) code review practices, system design thinking Experience with big data frameworks such as Spark or Databricks.
4+ years' experience using Python for maintainable, testable data engineering and Spark or Databricks for large scale processing.
Experience with workflow orchestration tools such as Airflow.
Experience with streaming technologies, notably Kafka, in distributed environments.
Proven work handling high volume structured and unstructured data (logs, telemetry, text) at scale.
Familiarity with AWS, Azure, or GCP data services and building cloud native data architectures.
Cross functional collaborator with strong communication skills for explaining complex systems to technical and non technical audiences.
PLUSES
Please note that these are desirable skills and are not required to apply for the position.
Databricks platform experience (Delta Lake, Unity Catalog, Workflows).
Containerization and orchestration (Docker, Kubernetes).
Experience with Snowflake, Cassandra, or other modern data platforms.
Experience building, maintaining, or scaling ML infrastructure.
Experience with CI/CD and deployment tools (TeamCity, Octopus) and Artifact Repositories (JFrog, Proget).
Experience with Terraform.
Gaming industry experience or passion for games.
HOW TO APPLY
Please apply with a CV and cover letter demonstrating how you meet the skills above. If we would like to move forward with your application, a Rockstar recruiter will reach out to you to explain next steps and guide you through the process.
If you've got the right skills for the job, we want to hear from you. We encourage applications from all suitable candidates regardless of age, disability, gender identity, sexual orientation, religion, belief, race, or any other protected category.
#LI-RN1
Additional Information
At Rockstar Games, we create world-class entertainment experiences.
Become part of a team working on some of the most rewarding, large-scale creative projects to be found in any entertainment medium - all within an inclusive, highly motivated environment where you can learn and collaborate with some of the most talented people in the industry.
Rockstar is seeking a Senior Data Engineer to join our online services team, building an innovative game analytics platform and tools to better understand our players and enhance their experience across our titles.
This is a full-time, in-office position based in Rockstar's large game development studio in Bangalore, India.
WHAT WE DO
The Rockstar Games Data Engineering team provides insights and actionable results to a wide variety of teams across the organization in support of their decision making.
We work with petabyte-scale data in Azure and Databricks, building both real-time and batch pipelines that power analytics, machine learning, and player experience improvements.
Rockstar Games · Bengaluru, India