Senior Application Architect-Databrick

Responsibilities

• Configure and manage Databricks workspaces, clusters, and jobs
• Optimize data workflows for performance, cost, and scalability
• Integrate Databricks with cloud platforms (Azure, AWS) and external data sources
• Monitor system performance and troubleshoot issues in production environments
• Implement data security, governance, and access controls
• Collaborate with data engineers, data scientists, and business stakeholders
• Support CI/CD pipelines for data and analytics solutions
• Maintain documentation for architecture, processes, and workflows
• Stay up to date with new Databricks features and best practices
• ________________________________________
• Required Qualifications
• Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 3+ years of experience in data engineering or big data platforms
• Hands-on experience with Databricks and Apache Spark
• Strong programming skills in Python, SQL, and/or Scala
• Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable)
• Understanding of data warehousing concepts and ETL/ELT processes
• Experience with distributed computing and large-scale data processing
• Familiarity with version control systems (e.g., Git)
• ________________________________________

Requirements

• Databricks certifications (e.g., Databricks Certified Associate/Professional)
• Experience with Delta Lake and Lakehouse architecture
• Knowledge of data orchestration tools (e.g., Airflow, Azure Data Factory)
• Experience with machine learning workflows on Databricks
• Familiarity with infrastructure-as-code tools (e.g., Terraform)
• ________________________________________
• Key Skills
• Data pipeline development and optimization
• Performance tuning and troubleshooting
• Cloud architecture and integration
• Data governance and security
• Analytical thinking and problem-solving
• Strong communication and collaboration skills
• Success Metrics
• Reliability and uptime of data systems
• Performance improvements in data pipelines
• Cost optimization of Databricks workloads
• Timely resolution of system issues
• Stakeholder satisfaction with data delivery
• Required Job Qualifications:
• Bachelor degree and 5 years Information Technology experience OR Technical Certification and/or College Courses and 7 year Information Technology experience OR 9 years Information Technology experience.
• 3+ years of experience in data engineering or big data platforms
• Hands-on experience with Databricks and Apache Spark
• Strong programming skills in Python, SQL, and/or Scala
• Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable)
• Understanding of data warehousing concepts and ETL/ELT processes
• Experience with distributed computing and large-scale data processing
• Familiarity with version control systems (e.g., Git)
• Problem solving / analytical thinking.
• Teamwork and collaboration.
• Preferred Job Qualifications:
• Bachelor degree in Computer Science or Information Technology
• Product-specific application architecture.
• Ability to tie together solutions across systems.
• Are you being referred to one of our roles? If so, ask your connection at HCSC about our Employee Referral process!
• Pay Transparency Statement:
• The compensation offered will vary depending on your job-related skills, education, knowledge, and experience. This role aligns with an annual incentive bonus plan subject to the terms and the conditions of the plan.
• HCSC Employment Statement:
• We are an Equal Opportunity Employment employer dedicated to providing a welcoming environment where the unique differences of our employees are respected and valued. All qualified applicants wi

Benefits

Additional Information

At HCSC, our employees are the cornerstone of our business and the foundation to our success. We empower employees with curated development plans that foster growth and promote rewarding, fulfilling careers. Join HCSC and be part of a purpose-driven company that will invest in your professional development. Job Summary We are seeking a skilled Databricks Architect to design, implement, optimize, and support data platforms built on Databricks. This role focuses on managing large-scale data processing systems, ensuring performance, reliability, and scalability of data pipelines, and enabling advanced analytics and machine learning workloads. ________________________________________

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at hcsc? Share your experience