Senior Deep Learning Scientist, Multimodal Agentic RL
NVIDIA· Engineer, Sys SW
Hybrid (Remote / Local)$184k - $287.5kFull-timePosted 2mo ago
About the role
Senior Deep Learning Scientist focused on advancing streaming and agentic multimodal AI, including development and deployment of large language and multimodal models, alignment methods, and embodied AI capabilities within NVIDIA’s Nemotron Omni and VoiceChat platforms.
Responsibilities
- Apply fundamental and applied research to develop, train, fine-tune, and deploy large language models for agentic systems encompassing audio-visual reasoning, tool usage, and document understanding.
- Advance post-training and alignment methods including instruction tuning, preference optimization, and RLHF/RLVR/MOPD to improve multimodal agents for complex use cases.
- Research and develop agentic reasoning and grounded perception capabilities, focusing on planning, tool execution, and long-horizon task completion across digital and physical environments.
- Lead the collection, development, and benchmarking of multimodal datasets, ensuring high-quality evaluation of model accuracy, safety, and task completion success.
Qualifications
- Master’s degree (or equivalent experience) or PhD in Computer Science, AI, or Applied Math with 8+ years of relevant work experience.
- Excellent programming skills in Python with strong fundamentals in scalable model development and deep learning frameworks like PyTorch.
- Strong knowledge of ML/DL techniques and modern foundation model architectures, including Transformers and mixture-of-experts models.
- Foundational understanding of reinforcement learning algorithms and implementation, including MDPs, policies, and reward design.
- Hands-on experience in post-training multimodal models for omni-modality (audio-visual) reasoning, full-duplex voice chat, and human-AI interaction.
- Proven ability to manage model development life cycles, including dataset versioning, experiment tracking, and evaluation pipelines.
Skills
Required:PythonPyTorchTransformersReinforcement LearningMultimodal Modeling (audio-visual)Experiment Tracking
Nice to have:Mixture-of-Experts
Benefits
- Equity
- Comprehensive benefits package
Last updated Oct 9, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect