Design and Implement Configurable Data Ingestion ETL framework including Data Quality, transformation and modelling. Implement Lakehouse solutions using Microsoft Fabric and paving the road to PGIM future state using Azure services and Fabric Infrastructure.
Develop and deploy data integration solutions, including data ingestion, transformation, and delivery to consumers within Microsoft Fabric, while utilizing optimal storage formats and layers.
Work with Infrastructure/Devops teams to come up with CI/CD pipelines as a framework that can be extended across organization.
Architect solutions that incorporate BI tools like Power BI ensuring seamless data integration for analytics and reporting.
Ensure data accuracy, consistency, and integrity across the data warehouse ecosystem by crafting robust solution designs.
Design and Build AI solutions leveraging search, embeddings, retrieval, ranking and Retrieval-Augmented Generation (RAG).
Set up roadmap for AI as a service to consuming systems and business stakeholders.
Establish a workspace architecture strategy through design and implement of data warehouse and lakehouse solutions allowing data sharing between different teams avoiding duplication, yet adhering to security and governance rules.
Lead a small team to design/build and monitor data and AI solutions.
Ensure teams follow best practices and standards for security, compliance, scalability, reliability, and performance.
Serve as SME in the Fabric space to technology partners, provide hands on training to development teams, and mentor business areas to maximize Fabric AI Capabilities.
Create and maintain comprehensive documentation (Playbooks) of solution architectures to internal and external stakeholders covering Data Fabric architecture, processes, and procedures.
Collaborate closely with our business and technology partners including data analysts, architects, engineers, and client stakeholders to gather requirements and translate them into scalable Microsoft Fabric solutions.
Requirements
Bachelor's or Master's degree in Computer Science, Data Engineering or related discipline.
10+ years of experience in cloud computing with Microsoft Azure leading migrations, integrations, and deployments. 10+ years of experience as a Data Architect, with demonstrated expertise in designing, managing, and deploying client solutions.
Strong knowledge of Azure services and features including Azure Synapse Analytics, Azure Data Factory, Azure Storage Accounts, Azure Logic Apps, Azure Functions, Azure SQL Database, Azure Active Directory, Azure DevOps, Azure Monitor, etc.
Build and deploy intelligent applications using Azure AI Foundry, leveraging prompt orchestration, grounding with Azure AI Search, and agent orchestration features for enterprise-scale GenAI use cases. Independently implement GenAI workflows using Foundry.
Proficient in CI/CD pipelines to deploy in azure environment using GitHub Actions.
Proven ability to implement data governance tools (Purview preferred), data securit
Pru · Newark, NJ