← All roles

Senior Research Scientist, Multimodal Foundation Models and Robotics

NVIDIA· Research Staff Member
Apply on company site
Santa Clara, CA$192k - $304.8kFull-timePosted 5mo ago

About the role

Senior research scientist role in NVIDIA's Generalist Embodied Agent Research (GEAR) group focusing on multimodal foundation models and robotics to build general-purpose embodied agents that learn across virtual and physical environments.

Responsibilities

  • Design and implement novel AI algorithms and models for general-purpose humanoid robots and embodied agents
  • Develop large-scale AI training and inference methods for foundation models
  • Optimize and deploy AI models in physical simulation and on robot hardware
  • Collaborate with research and engineering teams across NVIDIA to transfer research to products and services.

Qualifications

  • A Ph.D. in Computer Science/Engineering, Electrical Engineering, or equivalent research experience
  • 5 years of relevant work/research experience in Multimodal Foundation Models and/or Robotics
  • Multimodal Foundation Models: hands-on training experience and publications in LLMs, large vision-language models, video generative models and diffusion algorithms, or action-based transformers; strong software prototyping and model training skills (Python required; PyTorch/Jax/TensorFlow; C++/CUDA a plus); experience with large-scale ML/AI systems and compute infrastructure
  • Robotics: hands-on training experience and publications in robot learning (reinforcement learning, imitation learning, classical control); strong programming in Python, C++, ROS; understanding of kinematics/dynamics/sensors; safe operation of robot hardware; knowledge of PID, MPC, whole-body control; familiarity with MuJoCo and Isaac Sim; robot hardware design and hands-on building experience.

Skills

Required:Ph.D. or equivalent research experience in relevant fieldExperience with multimodal foundation modelsProficiency in Python; experience with PyTorch/Jax/TensorFlow; C++/CUDA a plusRobotics expertise (robot learning, control, sensors)Hardware operation and safety

Benefits

  • Equity
  • Benefits (see company benefits page)
Last updated Jul 3, 2026. Interested? Apply on the company site.

About NVIDIA

World Leader in AI Computing

NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.

AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at NVIDIA