Design & Development Build scalable and robust AI-driven applications using LLMs and agentic frameworks.
Implement vector database solutions to enable semantic search, RAG (retrieval augmented generation), and knowledge management.
Develop orchestration pipelines with frameworks like LangChain, Semantic Kernel, AutoGen, or emerging agentic frameworks such as Agno and Parlant .
Automation & Integration Integrate workflow automation platforms ( n8n, dify.ai Power Automate, etc. ) with AI systems to deliver end-to-end business solutions.
Ensure seamless integration with existing enterprise software ecosystems and APIs.
Quality & Evaluation Apply or contribute to LLM evaluation methodologies, leveraging platforms like Arize, DeepEval, or IBM WatsonX for model benchmarking, monitoring, and continuous improvement.
Establish best practices for testing, performance tuning, and evaluation of agentic/LLM-based workflows.
Collaboration & Delivery Work closely with cross-functional teams including data scientists, software engineers, and product owners.
Translate business requirements into technical designs and deliver working AI-powered applications in production environments.
Required Skills & Qualifications
Strong background in software engineering (e.g., system design, distributed systems, APIs, CI/CD).
Proven experience in building Generative AI and/or agentic systems .
Hands-on expertise with: LLMs and model fine-tuning or integration.
Agentic frameworks (Pydantic AI, Agno, Parlant, or similar).
Proficiency in at least one major programming language such as Python or .NET (strong engineering fundamentals matter more than specific syntax).
Hands-on experience architecting, deploying, and operating cloud-native solutions on one or more major hyperscale platforms (Azure, AWS, or GCP)
Experience with workflow automation tools like n8n, dify.ai, Power Automate, or similar platforms.
Nice-to-Have Skills
Familiarity with LLM evaluation frameworks (Arize, DeepEval, IBM WatsonX).
Contributions to open-source AI frameworks or communities.
Experience in MLOps, monitoring, and model deployment pipelines.
Requirements
A problem-solver with strong engineering rigor and curiosity for cutting-edge AI .
Comfortable moving between architecture, coding, and deployment .
Passionate about transforming abstract business needs into intelligent, production-ready systems.
Salary range for this role is between $84,000 and $128,000 .
Why BDO?
Our people-first approach to talent has earned us a spot among Canada's Top 100 Employers for 2026 . This recognition is a milestone we're thrilled to add to our collection of awards for both experienced and student talent experiences.
Our firm is committed to providing an environment where you can be successful in the following ways:
We enable you to engage with how we change and evolve, being a key contributor to the success and growth of BDO in Canada.
We help you become a better professional within our services, industries, and markets with extensive opportunities for learning and development.
We support your achievement of personal goals outside of the office and making an impact on your community.
Giving back adds up: Where company meets community. BDO is actively involved in our communities by supporting local charity initiatives. We support staff with local and national events where you will be given the opportunity to contribute to your community.
Everyone counts: We believe every employee should have the opportunity to participate and succeed
Benefits
Flexible schedule
Additional Information
Putting people first, every day
BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. In turn, we offer an award-winning environment that fosters a people-first culture with a high priority on your personal and professional growth.
Your Opportunity
We are seeking an experienced AI Engineer with a strong foundation in software engineering and a proven track record of building Generative and Agentic AI solutions . This new role is ideal for someone who thrives at the intersection of software development, applied AI research, and practical solution design. You will be responsible for designing, implementing, and deploying production-grade AI systems that leverage the latest in large language models (LLMs) , orchestration frameworks, and agentic architectures.
Bdo · Toronto - Bay St