Staff, Data Engineer
ExternalPrepare for this interview
EliteAI-generated questions, company research, and talking points tailored to this role
About the role
The Enterprise People Technology team supports the successful deployment and adoption of new People technology across the enterprise. As a Fortune #1 company, our work impacts millions of associates globally. We strive to continuously improve people technology and products to help managers and associates so they can focus on what matters most - supporting our customers and members. People Technology is one of the major segments of Walmart Global Tech's Enterprise Business Services, which is invested in building a compact, robust organization that includes service operations and technology solutions for Finance, People, and the Associate Digital Experience.
Responsibilities
- Design, Build and Enhance high performance reusable framework for data pipeline
- Develop and deploy cutting edge solutions at scale, impacting millions of customers worldwide to drive value from data at Walmart Scale
- Support People Data applications ensuring Data Quality and Governance standards.
- Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the technical community.
- Provide guidance and mentorship to junior data engineers.
- Ensure data ingested and processed is accurate and of high quality by implementing data quality checks, data validation, and data cleaning processes
Requirements
- Bachelors/masters degree in computer science or a related field
- With 8+ years experience in development of big data technologies/data pipelines
- Proficiency in managing and manipulating huge datasets in the order of terabytes (TB) is essential.
- Expertise in big data technologies like Hadoop, Apache Spark (Scala preferred), Apache Hive, or similar frameworks on the cloud (GCP preferred, AWS, Azure etc.) to build batch data pipelines with strong focus on optimization, SLA adherence and fault tolerance.
- Expertise in building idempotent workflows using orchestrators like Airflow.
- Expertise in writing SQL to analyze, optimize, profile data preferably in Big Query or SPARK SQL
- Strong data modeling skills are necessary for designing a schema that can accommodate the evolution of data sources and facilitate seamless data joins across various datasets.
- Ability to work directly with stakeholders to understand data requirements and translate that to pipeline development / data solution work.
- Strong analytical and problem-solving skills are crucial for identifying and resolving issues that may arise during the data integration and schema evolution process.
- Ability to move at a rapid pace with quality and start delivering with minimal ramp up time will be crucial to succeed in this initiative.
- Effective communication and collaboration skills are necessary for working in a team environment and coordinating efforts between different stakeholders involved in the project.
- About Walmart Global Tech
- Our hubs: Walmart is a global company with offices across the United States and around the world. Our global headquarters is in Bentonville, Arkansas, with primary hubs in the San Francisco Bay area and New York/New Jersey.
Benefits
Additional Information
Position Summary... Come join our People Data Engineering Team @Walmart where you'll have the opportunity to manage people data at Walmart scale and make sure the consistent data is being utilized across transactional and analytical systems. What you'll do...
Your Match
How well this role fits your profile.
Company Intel
What employees say
Worked at Walmart? Share your experience