Principal Engineer - Agentic AI Architect

About the role

This role is ideal for a senior technical leader who can: bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture and drive innovation in next-generation AI systems .

Responsibilities

• AI Architecture & System Design
• Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
• Architect RAG pipelines for enterprise-scale knowledge integration
• Define end-to-end AI system architecture from data ingestion → reasoning → action
• Agentic AI & LLM Development
• Develop advanced workflows using:
• tool-using agents
• planning & reasoning agents
• multi-agent collaboration frameworks
• Evaluate and integrate leading LLMs (open-source and proprietary)
• Optimize prompt engineering, memory, and reasoning capabilities
• Hardware-Aware AI Optimization
• Co-design AI systems with:
• FPGA acceleration
• ASIC platforms
• heterogeneous compute (CPU/GPU/FPGA)
• Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
• Collaborate with hardware teams on EDA and system integration
• Framework & Platform Development
• Build internal platforms using
• LangChain
• LlamaIndex
• custom agent orchestration framework
• Develop reusable components for:
• memory management
• tool integration
• knowledge retrieval
• Technical Leadership
• Lead architecture reviews and guide engineering teams
• Mentor senior engineers and influence cross-functional teams
• Drive innovation in AI + hardware convergence
• What Makes This Role Unique
• Opportunity to define agentic AI architecture for hardware-driven systems
• Work at the convergence of:
• AI reasoning systems
• FPGA acceleration
• next-generation computing platforms
• High-impact role influencing future AI + semiconductor integration
• Impact
• You will help shape how AI agents interact with hardware , enabling:
• intelligent system orchestration
• real-time decision-making pipelines
• scalable AI deployment on FPGA platforms

Requirements

• Master's or Bachelor's degree with 10+ years of experience in one or more of the following:
• AI/ML systems
• Distributed systems
• Hardware-software co-design
• Recognized expertise in AI/ Large Language Models (LLMs)
• Deep understanding of:
• LLM architectures and inference
• RAG systems and vector databases
• Agentic AI / autonomous agents
• Hands-on experience building:
• Production-grade LLM applications
• Multi-step reasoning and orchestration workflows
• Scalable and reliable AI systems in production
• Strong background in:
• FPGA / ASIC / EDA systems
• Heterogeneous computing architectures
• Familiarity with:
• Hardware acceleration for AI workloads
• Performance optimization across system stack
• Technical Skills
• Programming:
• Python
• C++ (preferred)
• Experience with:
• Distributed systems design
• APIs and microservices architecture
• Cloud and/or edge AI deployment
• Hands-on experience with:
• LLM fine-tuning, quantization, and model distillation
• On-device / edge AI deployment
• Robotics, autonomous systems, or real-time AI pipelines
• Knowledge of:
• Compiler stacks (e.g., MLIR, TVM)
• AI model optimization for FPGA platforms
• Job Type:
• Regular
• Shift:
• Shift 1 (China)
• Primary Location:
• Shanghai, China
• Additional Locations:
• Posting Statement:

Additional Information

Job Details: Job Description: Location: Shanghai, China Role Overview We are seeking a Principal Engineer - Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms . This role sits at the intersection of: Large Language Models (LLMs) Agent frameworks & autonomous systems Retrieval-Augmented Generation (RAG) Hardware-aware AI system design (FPGA / ASIC / EDA) You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration .

Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at altera? Share your experience