Skip to main content
Back to jobs

Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles

External
NVIDIA logoNvidia · Santa Clara, CA
Full-timeOn-site4w ago
PythonPyTorchComputer Vision
Cover LetterConnect

Prepare for this interview

Elite

AI-generated questions, company research, and talking points tailored to this role


Responsibilities

  • Develop and improve the technical design, architecture, and roadmap for 3D obstacle perception to support end-to-end autonomous driving functionalities, leveraging state-of-the-art CNN and transformer-based architectures where appropriate.
  • Design and implement advanced 3D perception models using multi-camera inputs and/or multi-sensor fusion (camera, radar, lidar) for obstacle detection and tracking, including opportunities to explore BEV and transformer-based 3D perception.
  • Collaborate with safety, systems, and software teams to ensure perception solutions meet product requirements for safety, latency, resource usage, and software robustness, and are ready for deployment at scale.
  • What we need to see:
  • PhD with 4+ years, MS with 6+ years, or BS (or equivalent experience) with 8+ years of relevant experience in Computer Science, Computer Engineering, or a related technical field.
  • Hands-on experience developing deep learning-based perception or closely related systems for complex real-world problems, with strong proficiency in frameworks such as PyTorch and a track record of taking models from prototype to production.
  • Proven experience in data-driven development, including close collaboration with data, labeling, and ground-truth teams on data strategy, labeling quality, and iterative model improvement.
  • Strong programming skills in Python and/or C++, with experience building reliable, high-performance, production-quality software.
  • Excellent communication and collaboration skills, with the ability to work effectively across multidisciplinary teams.
  • Ways to stand out from the crowd:
  • Experience designing and deploying perception solutions for autonomous driving or robotics using camera-based deep learning at scale.
  • Strong publication record or recognized contributions in deep learning, computer vision, or autonomous systems at leading conferences/journals (e.g., CVPR, ICCV, NeurIPS, IROS).
  • Deep understanding of 3D computer vision fundamentals, including camera modeling and calibration (intrinsic and extrinsic), multi-view geometry, and 3D representations, ideally with experience applying these concepts in transformer-based 3D or BEV perception pipelines.
  • Experience with CUDA development and optimizing training or inference pipelines through custom CUDA kernels or other GPU-accelerated components.
  • Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5. You will also be eligible for equity and benefits .
  • Applications for this job will be accepted at least until May 25, 2026. This posting is for an existing vacancy.

Additional Information

Intelligent machines powered by artificial intelligence-computers that can learn, reason, and interact with people-are transforming every industry. GPU-accelerated deep learning provides the foundation for machines to perceive, reason, and solve complex problems. NVIDIA GPUs run deep learning algorithms that simulate aspects of human intelligence, acting as the brain of computers, robots, and self-driving cars that can perceive and understand the world. We are seeking an exceptional Senior Perception Engineer to help design and productize NVIDIA's next-generation autonomous driving perception stack. You will work on the core 3D obstacle perception pipeline, contribute to architecture and algorithm design, and remain deeply hands-on with implementation, including modern transformer-based, multi-modal, and vision-language techniques where they add real value.


Your Match

How well this role fits your profile.

Company Intel

What employees say

Worked at NVIDIA? Share your experience

Interested in this role?

Apply on the company's website.

Cover LetterConnect
Senior Perception Engineer, Obstacle Foundation Models - Autonomous Vehicles at Nvidia