Senior Deep Learning Software Engineer, Inference
NVIDIA· Engineer, Sys SW
Hybrid (Remote - Netherlands), Hybrid (Remote - Germany), Hybrid (Remote - Poland)PLN 221.3k - PLN 383.5kfull-timePosted 2mo ago
About the role
Senior Software Engineer focused on GPU-accelerated deep learning inference, contributing to high-performance frameworks (e.g., SGLang, vLLM) and optimizing model serving and inference across NVIDIA accelerators.
Responsibilities
- Performance optimization, analysis, and tuning of DL models in various domains like LLM, Multimodal and Generative AI.
- Scale performance of DL models across different architectures and types of NVIDIA accelerators.
- Contribute features and code to NVIDIA’s inference libraries, vLLM and SGLang, FlashInfer and LLM software solutions.
- Work with cross-collaborative teams across frameworks, NVIDIA libraries and inference optimization innovative solutions.
Qualifications
- Masters or PhD or equivalent experience in Computer Engineering, Computer Science, EECS, AI
- 5+ years of relevant software development experience
- Excellent C/C++ programming and software design skills
- SW Agile skills are helpful; Python experience is a plus
- Prior experience with training, deploying or optimizing the inference of DL models in production is a plus
- Prior background with performance modeling, profiling, debug, and code optimization or architectural knowledge of CPU and GPU is a plus
Skills
Required:C/C++ programmingSoftware design
Nice to have:PythonPerformance modeling and profilingCUDA/CUDA kernelsMulti-GPU communications (NCCL, NVSHMEM)Deep Learning frameworks (SGLang, vLLM, PyTorch)
Benefits
- Extensive benefits package
- Work environment that promotes diversity, inclusion, and flexibility
Last updated Oct 23, 2026. Interested? Apply on the company site.
About NVIDIA
World Leader in AI Computing
NVIDIA invents the GPU and drives advances in AI, HPC, gaming, creative design, autonomous vehicles, and robotics.
AIautonomous vehiclesgaminggpugraphics cardhigh performance computingliquid-ai-recruiting-targetllm
More open roles at NVIDIA
- Senior Physical Verification Engineer3d agoEngineer, ASIC
- Senior System Software Engineer, Display Security3d agoEngineer, Sys SW
- Senior FPGA Prototyping Engineer - Hardware3d agoSanta Clara, CA · Engineer, ASIC
- Senior Product Engineer3d agoHybrid (Thailand) · Engineer, Product Development
- Senior Architect - Data Processing Systems, Analytics and Data Intelligence3d agoHybrid (Remote / Local) · Architect