Solutions Architect, Inference Deployments
NVIDIA· Architect, Solutions
Santa Clara, CA$152k - $241.5kFull-timePosted 7mo ago
About the role
Architect and deploy AI inference systems across edge and cloud for NVIDIA, leading customer engagements, optimizing models and data workflows, and enabling production deployments.
Responsibilities
- Lead architecture discussions with customers and co-design scalable inference systems with product and engineering teams. Define technical direction, integration milestones, and deployment plans across edge and cloud environments.
- Deploy, test, and profile speech and action models for robotics and automation on edge devices. Optimize latency, throughput, and memory use within device constraints.
- Lead optimization of synthetic data workflows spanning generation, augmentation, filtering, and data movement. Improve throughput and cost per usable output while preserving data quality.
- Guide production inference deployments, including configuration, monitoring, capacity planning, performance testing, release validation, and rollback. Resolve complex issues across models, runtimes, and infrastructure.
- Evaluate model optimization methods, including quantization, kernel selection, and batching. Validate application quality, explain performance tradeoffs, and use findings to inform product and engineering priorities.
- Drive customer and field enablement through deployment recipes, demos, onboarding materials, and operating guides that help teams adopt and scale NVIDIA technologies.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent experience.
- 5+ years of professional experience in software or hardware engineering, developer relations, technical partnerships, solutions architecture, or product management, including 3+ years of direct, hands-on experience in AI inference or ML systems.
- Deep expertise in AI/ML and GPU inference, with a track record of driving product integrations and delivering production systems across edge or cloud environments.
- Hands-on experience building AI agents and working with Linux systems, containers, and at least one inference runtime or ML framework.
- Demonstrated expertise in performance profiling and production deployment, including monitoring and troubleshooting. Ability to design repeatable benchmarks that measure performance and application quality.
- Ability to explain complex technical concepts clearly to technical and non-technical audiences, from engineers to C-level executives.
- Strong problem-solving skills, intellectual curiosity, and a commitment to learning and helping customers resolve complex technical challenges.
- A track record of building trusted customer and partner relationships, balancing their needs, and guiding complex product and architecture decisions.
Skills
Required:AI/ML InferenceEdge and Cloud DeploymentPerformance Profiling and BenchmarkingLinux, Containers
Benefits
- Equity and benefits program (eligible)
Last updated Oct 16, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer4d agoEngineer, ASIC
- Senior System Software Engineer, Display Security4d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware4d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer4d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence4d agoHybrid (Remote / Local) · Architect