Data Engineer (Python, PySpark, Snowflake, Databricks) - Cloud Data Pipelines, Automation & Compliance

Requirements

• Bachelor's or Master's degree in Data Engineering, Computer Science, or related field
• 6+ years of experience supporting, deploying, and managing enterprise data solutions in cloud environments supported by Snowflake and Databricks
• Relev

Benefits

Additional Information

Job Summary Synechron is seeking an experienced Snowflake Support Engineer with strong expertise in Python, Databricks, and PySpark to support enterprise data platform operations. This role involves managing Snowflake data warehousing solutions, optimizing data workflows, and providing technical support to ensure high availability, security, and performance for critical business processes. The ideal candidate will drive automation, guide technical teams, and stay current with industry trends to enhance data platform reliability and scalability. Software Requirements Required Software Proficiency: Python (version 3.7+) - extensive experience in scripting, automation, and data processing Databricks - hands-on experience in managing and developing data pipelines within Databricks environments PySpark - strong skills in large-scale data processing and transformation workflows Snowflake - expertise in data warehousing, data loading, schema design, and performance tuning SQL - advanced query writing, optimization, and data validation Git and version control: GitHub, Bitbucket - for code management and collaboration Cloud platforms (AWS, Azure, GCP) - familiarity with deploying and managing data solutions supported by cloud services Preferred Software Skills: Automation and orchestration tools: Jenkins, Azure DevOps, or Terraform - for CI/CD and infrastructure automation Monitoring tools: Prometheus, Grafana, CloudWatch - for system health and performance monitoring Data modeling and metadata management tools supporting data governance standards Overall Responsibilities Support and maintain scalable, secure, and high-performance data pipelines in Snowflake and Databricks environments Automate operational workflows, data load processes, and pipeline health monitoring to improve efficiency and reliability Troubleshoot and resolve data ingestion, transformation, and performance issues promptly Collaborate with data engineers, data scientists, and business analysts to translate requirements into optimized data workflows Support schema design, data validation, and data security compliance in line with industry regulations (GDPR, HIPAA, etc.) Monitor, analyze, and optimize resource consumption and performance of data workflows Develop and maintain documentation including process flows, operational procedures, and best practices Lead efforts in automation and continuous delivery through CI/CD pipelines and infrastructure as code frameworks Support data migration, system upgrades, and support audits for data security and compliance Technical Skills (By Category) Languages & Data Tools (Essential): Python (3.7+), PySpark, SQL - for scripting, data transformation, and automation Snowflake - data warehousing, schema management, and query optimization Databases & Data Management: Snowflake, relational databases, data modeling, and schema design Metadata and data lineage tools supporting data governance and compliance Cloud & Infrastructure: AWS, Azure, or GCP data services supporting cloud-native data architectures (preferred) Infrastructure as Code tools: Terraform, CloudFormation (preferred) Monitoring & Automation: Prometheus, Grafana, CloudWatch - for system monitoring and alerting Jenkins, Azure DevOps, or similar tools for CI/CD pipeline automation Security & Data Governance: Knowledge of encryption standards, access controls, and compliance frameworks (GDPR/HIPAA) Experience Requirements 6+ years supporting enterprise data platforms with a focus on Snowflake, Databricks, and cloud data workflows Proven experience optimizing large-scale data pipelines for performance and cost efficiency Demonstrated ability to troubleshoot, automate, and support high-availability data systems in cloud environments Experience supporting data migration projects, schema management, and data security compliance in regulated industries (preferred) Familiarity with enterprise metadata management and data governance standards Day-to-Day Activities Develop, support, and optimize data pipelines in Snowflake and Databricks environments Automate ingestion, transformation, and validation workflows supporting business analytics and compliance Monitor system health, troubleshoot errors, and implement performance tuning and security improvements Collaborate with data engineers, data scientists, and business stakeholders to refine workflows Support data migration, configuration, and operational readiness activities Conduct root cause analysis, incident response, and performance reviews Maintain operational documentation including architecture diagrams, runbooks, and data policies Support infrastructure automation and CI/CD pipelines for deployment and upgrades

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at synechron? Share your experience