Data Engineer II

Responsibilities

• Ensures data governance and security by validating data for accuracy and consistency, and maintaining secure, compliant data environments. Follows best practices and regulatory standards (e.g., HIPAA) to protect sensitive information and uphold data integrity.
• MARGINAL OR PERIODIC FUNCTIONS:
• Adheres to internal controls and reporting structure.
• Performs related duties as required.
• KNOWLEDGE/SKILLS/ABILITIES
• Big Data Processing: Proficiency with big data frameworks such as Apache Spark for distributed data processing and large-scale computations. Experience optimizing Spark jobs for performance is often required.
• Workflow Orchestration : Experience with workflow orchestration tools like Apache Airflow (or similar platforms) to schedule and manage complex data pipelines. Ability to design reliable job workflows and handle dependencies between tasks.
• Version Control: Experience using Git or other version control systems for managing codebases and collaborating on data projects. Follows best practices in code versioning and documentation to maintain a clear history of changes.

Benefits

Additional Information

Job Posting Title: Data Engineer II ---- Hiring Department: Dell Medical School ---- Position Open To: All Applicants ---- Weekly Scheduled Hours: 40 ---- FLSA Status: Exempt from FLSA ---- Earliest Start Date: Immediately ---- Position Duration: Expected to Continue ---- Location: AUSTIN, TX ---- Job Details: General Notes Data Engineer II is an experienced data professional responsible for designing, building, and maintaining robust data pipelines and infrastructure that enable the collection, storage, and processing of large datasets. This role expands upon the Data Engineer I position by handling more complex data projects and working with greater independence. A Data Engineer II ensures data is accurate, secure, and compliant with data governance standards. A Data Engineer II collaborates with cross-functional teams (e.g., business stakeholders, IT, and subject-matter experts) to deliver solutions that meet business and research needs.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at utaustin? Share your experience