Data Engineer

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Teradata SQL, Informatica PowerCenter, Apache Spark, QueryGrid, and Trino.
• Build and maintain enterprise data warehouse (EDW) and data mart solutions.
• Develop robust data ingestion and transformation frameworks across Teradata and Hadoop platforms.
• Perform performance tuning and optimization of complex ETL and database applications to improve efficiency and reduce resource utilization.
• Create automation frameworks using GCFR, Shell scripting, and BTEQ for end-to-end process orchestration and integration.
• Build and enhance CDC (Change Data Capture) frameworks using Java for processing SAP Oracle OLR logs and ingesting data into Teradata.
• Develop configurable ingestion frameworks and reusable components for scalable data processing.
• Support installation and implementation of Master Data Management (MDM) applications, including data validation and approval workflows.
• Collaborate with cross-functional teams to ensure reliable integration of enterprise data sources.
• Required Skills
• Strong experience in Teradata ETL development and Informatica PowerCenter.
• Hands-on experience with Hadoop ecosystem technologies including Hive, Impala, Spark, Kafka, Iceberg, Ranger, Atlas, NiFi, and Flink.
• Strong SQL and performance tuning expertise.
• Experience in Shell scripting, Java, and automation frameworks.
• Good understanding of Data Warehousing concepts, CDC, and MDM solutions.
• Experience in large-scale enterprise data processing environments.

Requirements

• Experience with real-time data ingestion and orchestration tools.
• Strong analytical and troubleshooting skills.
• Ability to work independently in a fast-paced environment.

Additional Information

Data Engineer - L3 Location: Singapore Experience: 5-8 Years Salary: Up to SGD 8K Employment Type: Contract - 1 year Job Description We are looking for a skilled Data Engineer to design, develop, and optimize scalable ETL/ELT solutions across Teradata and Hadoop ecosystems. The ideal candidate should possess strong hands-on expertise in enterprise data engineering, data warehousing, CDC frameworks, and big data technologies.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at LION & ELEPHANTS CONSULTANCY PTE. LTD.? Share your experience