Senior Data Engineer
ExternalPrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
Requirements
- 8+ years of experience in Data Engineering, Software Engineering, or related technical subject areas.
- 5+ years of hands-on experience with Python development for data engineering and automation solutions.
- 3+ years of hands-on experience with PySpark and distributed data processing frameworks in enterprise-scale environments.
- Strong expertise in Database Design, SQL, and Relational Data Modelling.
- Shown experience designing, building, and supporting enterprise-scale data pipelines and data platforms.
- Strong experience in data engineering architecture and solution design , including data lakes, data warehouses, Lakehouse architectures, data integration patterns, and scalable data processing solutions.
- Proven track record to design end-to-end data solutions covering data ingestion, transformation, storage, orchestration, governance, and consumption layers.
- Strong proven understanding of AWS cloud services and experience building, deploying, and supporting cloud-native data solutions.
- Experience with AWS data engineering services such as S3, Glue, EMR, Lambda, Athena, Redshift, Step Functions, Event Bridge, or equivalent technologies.
- Hands-on experience with Databricks , including development, optimization, and operational support of large-scale data processing workloads.
- Strong understanding of Solution Architecture, System Design, and Engineering Best Practices.
- Experience with Infrastructure as Code, CI/CD pipelines, configuration management, and deployment automation.
- Experience with source control and code management tools such as Git.
- Knowledge of service operations, observability, resilience engineering, disaster recovery, and operational support models.
- Strong understanding of information security, data governance, and data privacy best practices.
- Excellent communication, collaborator management, and collaboration skills.
- Proven track record to provide technical leadership, mentor engineers, influence architectural decisions, and contribute to high-performing teams.
- Legal Disclaimer:
Benefits
Additional Information
Entity: Technology Job Family Group: IT&S Group Job Description: eviews, technical standards, CI/CD practices, and automation. Lead source control, release management, and deployment processes for data engineering solutions. Facilitate technical discussions, architecture reviews, and technology decision-making across teams. Mentor engineers and contribute to building a high-performing engineering culture through knowledge sharing and technical leadership. Ensure compliance with information security, governance, and operational standard methodologies. Support the reliability, resilience, and continuous improvement of data platforms and services.
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at BP? Share your experience