Additional Information
We are seeking a Data Engineer II to design, build, and maintain scalable data pipelines and data infrastructure that support analytics, reporting, and machine learning initiatives. The ideal candidate has strong experience in SQL, AWS data analytics services, and Python, with hands-on experience building ETL/ELT pipelines using modern cloud-based tools.
2+ years of experience in Data Engineering, data platform development, or related roles, with strong proficiency in SQL and Python for data processing and pipeline development.
Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, and Apache Airflow.
Build and optimize data warehouses and data lakes using AWS Redshift, S3, and related AWS services.
Develop and manage data integration workflows using tools such as Airflow, Python, AWS Glue or Talend (optional).
Ensure data quality, reliability, and performance across pipelines and data platforms.
Optimize SQL queries, Redshift schemas, and data models for performance and scalability.
Prepare and deliver datasets for machine learning models for Forecasting usecases.
Implement CI/CD pipelines for data workflows and infrastructure deployments.
Monitor pipeline performance and troubleshoot production issues.
Maintain proper documentation and adhere to data governance and security best practices.
Participate in code reviews and contribute to improving engineering standards.
Experience with one or more cloud providers: AWS (Glue, S3, Redshift), Azure (Data Lake, Databricks), or GCP.
Experience with workflow orchestration tools such as Apache Airflow.
Familiarity with machine learning data pipelines or feature engineering workflows.
Understanding of data modeling, data warehousing concepts, and performance optimization.
Topgolf · Tg - Hq - Dallas Office