Senior Architect, Data Engineering

Responsibilities

• Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric
• Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop
• Design data structures for ingestion and reporting, specific to use case and technology
• Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric
• Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments
• Guide and coach consultants, share best practices, perform code reviews
• Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
• Ensure that data integrity issues are addressed
• Liaise and attend meetings necessary to perform duties and aid business and technical development
• Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities
• Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.

Requirements

• 10+ years of professional experience and 5+ within consulting ecosystem
• Very strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads
• Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies
• Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures
• Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
• Development of or architecture of modern distributed architectures using modern messaging patterns and tools
• Strong data engineering experience with the following core competencies:
• Experience with Databricks, Snowflake, and/or Fabric
• Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets
• Strong experience with ETL procedures and ideation from scratch
• Experience using cloud platforms such as AWS, Azure, GCP etc.
• Experience with reporting tools such as PowerBI and Tableau
• Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
• Excellent organizational, verbal and written communication skills
• A commitment to inclusion and diversity, and openness to new ideas and perspectives
• Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.
• Travel to client sites as needed (30% to 50%)
• Seattle or Washington, D.C.
• $199,100 - $223,400 USD
• Los Angeles
• $205,400 - $234,100 USD
• New York City or San Francisco
• $215,200 - $244,700 USD
• A location not listed above
• $183,800 - $212,800 USD
• Other consultancies talk at you.
• At West Monroe, we work with you.
• We're a global business and technology c

Benefits

Additional Information

Are you ready to make an impact? West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at westmonroe4? Share your experience