Develop ETL and data pipeline capabilities considering how data is created, transformed, stored, archived, analyzed, and shared across Western Alliance Bank and our partner systems.
Expert-level PySpark development experience, including: Writing dynamic, parameterized, and reusable PySpark code
Building shared frameworks, helper functions, and companion notebook structures
Performance tuning and optimization of Spark workloads
Implement Azure DevOps CI/CD pipelines for all data solutions in adherence to Western Alliance Bank technical standards.
Apply Test Driven Development methodology to all data solutions designed, built, and implemented.
Lead the implementation of outcomes, recommendations, and designs from Data Governance and Enterprise Architecture.
Perform data exploration and data profiling with tools such as SSAS.
Actively participate in making data architecture decisions.
Provide technical mentorship to team members and other data professionals.
Collaborate with product owners and business stakeholders to gain a working understanding of business requirements and operational processes.
Implement built-in quality and compliance- by-design in all data solutions.
Implement methods to include unstructured data and big data.
Requirements
5+ years' experience designing, implementing, and supporting cloud data solutions; Azure Data Lake, Azure Data Factory, Azure Data Services, Azure Synapse, Azure Logic Apps, and Azure DevOps experience strongly preferred.
Bachelor's degree in engineering or related field.
Expert level experience with at least one RDBMS and query language such as T-SQL, PL/SQL, Spark SQL.
Westernalliancebank · Phoenix, AZ