Manager 1, Software Development & Engineering

Responsibilities

• Data Pipeline Development: Design and implement scalable streaming jobs in Cloud and on-prem
• Optimize Spark jobs for performance and cost efficiency.
• Dev Ops: Develop and maintain automated tooling for operational montoring and maintenance of complex pipelines
• Implement best practices for distributed data processing and storage.
• Collaboration: Work closely with data scientists, analysts, and business stakeholders to deliver reliable datasets.
• Data Quality & Governance: Implement data validation, monitoring, and lineage tracking.
• Ensure compliance with security and privacy standards.
• Continuous Improvement: Research and adopt new technologies to improve Spark-based data engineering processes.
• Required Skills & Qualifications
• Technical Expertise: Strong proficiency in Spark/Scala
• Development Experience, familiarity with code repos, CI/CD
• Programming & Tools: Proficiency in Scala or Java .
• Cloud & Infrastructure: Hands-on experience with cloud platforms (AWS EMR, Azure Databricks, GCP Dataproc).
• Familiarity with CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation).
• Experience: 13+ years in engineering roles, with at least 6 years focused on Spark/Scala.
• Education: Bachelor's or Master's degree in Computer Science, Engineering, or related field.

Requirements

• Experience with real-time streaming (Kafka, Spark Streaming).
• Dockers / Kubernetes Experience
• Databricks Experience
• Knowledge of performance tuning and troubleshooting Spark jobs.
• Certifications in cloud platforms or big data technologies.
• Strong problem-solving and communication skills.
• #CIECTN25
• Please visit the benefits summary on our careers site for more details.
• Education
• Bachelor's Degree
• While possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.
• Certifications (if applicable)
• Relevant Work Experience
• 5-7 Years

Benefits

Additional Information

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast. Job Summary Responsible for leading a team of Software Development Engineers in the planning and designing of software and web applications. Manages projects from design to testing, including new programs, enhancements and modifications. Collaborates with Quality Assurance team to conduct testing. Has overall responsibility for developing/administering performance standards for organizational unit. Manages team which may include exempt and non-exempt employees. Provides subject matter guidance to employees as required. Develops processes and procedures to drive department efficiencies and assists in the development and meeting of departmental budget. Job Description Tech stacks: Expertise in Pyspark, Spark, Scala Or Java We are seeking an experienced D ata Engineering Manager to design, develop, and optimize large-scale streaming systems using Apache Spark. This role involves building high-performance data pipelines, and collaborating with cross-functional teams to enable advanced analytics and machine learning.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at Comcast? Share your experience