Data Engineer - Python, PySpark, Cloud Data Platforms & Migration Expertise

Benefits

Additional Information

Job Summary Synechron is seeking an experienced IDMC (Informatica Intelligent Data Management Cloud) Developer to design, implement, and maintain enterprise data integration solutions. This role involves building scalable ETL workflows, managing data pipelines, and ensuring data quality, security, and compliance across cloud and on-premise environments. The ideal candidate will leverage their expertise in cloud data services, API management, and data governance to support digital transformation, enable data-driven insights, and deliver high-quality, reliable data solutions aligned with business objectives. Software Requirements Required Software Proficiency: Informatica Cloud Services (IDMC / IICS) - hands-on experience in developing and managing data workflows (version 2022 and above preferred) SQL (MySQL, Oracle, SQL Server, PostgreSQL) - strong skills in data querying, transformation, and optimization Cloud platforms: AWS, Azure, or GCP - familiarity with data services and migration in cloud environments API management: REST APIs, Web Services - ability to design, consume, and manage API integration workflows Data integration tools and platforms supporting data pipelines and application integration Data governance and security frameworks supporting enterprise compliance Preferred Software Skills: Automation tools: CI/CD pipelines (Jenkins, Azure DevOps, GitLab) - for automation of deployment and workflows Data modeling, data warehouse concepts, and metadata management tools Cloud automation frameworks: Terraform, CloudFormation - for infrastructure as code and environment provisioning Overall Responsibilities Design, develop, and optimize scalable ETL/ELT workflows supporting enterprise data ingestion, transformation, and migration Build and maintain resilient data pipelines supporting analytics, reporting, and compliance needs in cloud and hybrid environments Collaborate with data architects, analysts, and developers to capture requirements and deliver robust data solutions Conduct data validation, reconciliation, and security assessments to ensure data quality and regulatory compliance, including GDPR and HIPAA Support data migration projects, system upgrades, and cloud adoption initiatives Implement data governance principles, access controls, and encryption measures to protect sensitive data Monitor, troubleshoot, and optimize data pipeline performance, resolving issues proactively Automate deployment processes, infrastructure provisioning, and workflow orchestration using Terraform, CloudFormation, and CI/CD tools Maintain detailed documentation of data architecture, workflows, security protocols, and operational procedures Technical Skills (By Category) Languages & Data Tools (Essential): SQL (MySQL, Oracle, PostgreSQL, SQL Server): data validation, queries, and performance tuning PySpark, Spark SQL: large-scale data processing and transformation workflows IDMC / IICS: designing, deploying, and managing cloud-native data pipelines Databases & Data Management: Relational databases, data modeling, and data warehousing concepts supporting enterprise analytics Metadata management and data lineage tools supporting compliance Cloud Technologies: AWS, Azure, or GCP data services, supporting deployment, integration, and migration Cloud automation tools like Terraform or CloudFormation (preferred) Frameworks & Libraries: PySpark, Delta Lake, Dataflow for data processing and lakehouse architectures Tools & Methodologies: CI/CD pipelines, Git, Terraform, Agile/Scrum practices supporting DevOps and continuous delivery Security & Compliance: Knowledge of encryption, role-based access controls, and data privacy standards (GDPR, HIPAA) Experience Requirements 5+ years of experience supporting enterprise-scale data pipelines and cloud data solutions Demonstrated expertise in designing, deploying, and managing data integration workflows in cloud environments Proven ability to support data migration, data quality assurance, and compliance initiatives Experience with analytics data platforms supporting business intelligence and reporting in regulated industries (preferred) Background supporting or implementing data governance, security, and privacy policies Day-to-Day Activities Develop, test, and maintain scalable ETL/ELT workflows supporting analytics, migration, and compliance Collaborate with business, data science, and application teams to capture and implement data requirements Monitor data pipelines, troubleshoot failures, and implement fixes to improve system reliability and performance Support data migration efforts, including schema validation, data transformation, and validation tasks Ensure data security, encryption, and access control measures are enforced across systems Automate environment setup, deployment, and management using Terraform, CI/CD, and cloud automation tools Document data architecture, process workflows, and security requirements for operational

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at synechron? Share your experience