← All roles

Software Engineer, GPU Performance

HeyGen· Engineering
Apply on company site
Posted 3w ago

About the role

Software Engineer focused on GPU performance to accelerate HeyGen's AI applications (Avatar IV, Photo Avatar, Interactive Avatar, Video Translation) by optimizing model execution, preprocessing, and inference infrastructure, with profiling and measurement to improve latency, throughput, and GPU cost.

Responsibilities

  • Use NVIDIA Nsight Systems, Nsight Compute, and PyTorch Profiler to investigate GPU utilization, kernel execution, memory bandwidth, and CPU–GPU data movement.
  • Identify bottlenecks across model execution, preprocessing, and inference serving, then measure the impact of each optimization.
  • Improve performance through batching, scheduling, memory management, and better GPU utilization.
  • Develop or integrate high-performance GPU kernels when existing implementations limit performance.
  • Build benchmarks and automated checks that catch performance regressions across representative video workloads.
  • Collaborate with AI researchers and infrastructure engineers to bring optimizations into production.
  • Measure the effect of changes on latency, throughput, cost, and output quality.]
  • qualifications["Experience optimizing GPU-based AI workloads or high-performance computing systems.","Proficiency in Python and experience with PyTorch or a similar machine learning framework.","Strong curiosity about GPU hardware, including memory bandwidth, cache behavior, tensor cores, and data movement between CPU and GPU.","Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.","Ability to turn performance experiments into reliable production changes and communicate tradeoffs clearly."]
  • benefits["Competitive salary and benefits package.","Dynamic and inclusive work environment.","Opportunities for professional growth and advancement.","Collaborative culture that values innovation and creativity.","Access to the latest technologies and tools."]
  • domains:[{"name":"GPU Performance Engineering","description":"Optimizing GPU usage for AI workloads across model execution, preprocessing, and inference serving.","categories":["ai / ml","high-performance computing"],"stage":"development"}]
  • skills:[{"name":"GPU performance optimization","description":"Experience optimizing GPU-based AI workloads or high-performance computing systems.","category":"technical","requirement":"required","proficiency_level":"expert","yoe":{"value":0}}, {"name":"Python","description":"Proficiency in Python and experience with PyTorch or a similar ML framework.","category":"technical","requirement":"required","proficiency_level":"expert","yoe":{"value":0}} , {"name":"Profiling tools","description":"Experience using profiling tools to connect hardware behavior to application-level bottlenecks and validate improvements.","category":"technical","requirement":"required","proficiency_level":"expert","yoe":{"value":0}} , {"name":"PyTorch","description":"Experience with PyTorch or a similar machine learning framework.","category":"technical","requirement":"required","proficiency_level":"expert","yoe":{"value":0}}]}
  • tech_stacks:[{"name":"NVIDIA Nsight Systems","description":"Profiling tool for GPU performance and CPU-GPU data movement.","category":"tool","area":"infra","importance":"primary"},{"name":"NVIDIA Nsight Compute","description":"Kernel-level GPU profiling tool.","category":"tool","area":"infra","importance":"primary"},{"name":"PyTorch","description":"ML framework for building and evaluating models.","category":"framework","area":"data","importance":"primary"}]
  • locations:[{"description":"Los Angeles, Palo Alto, San Francisco, Toronto, Singapore","location_type":"hybrid","location":"Los Angeles, Palo Alto, San Francisco, Toronto, Singapore"}]
  • compensations[]{},
  • notes_pairing_removed
  • compensations:[{"description":"Competitive salary and benefits package.","compensation_type":"base","unit":"year","currency":"usd"}]
Last updated Sep 30, 2026. Interested? Apply on the company site.
HeyGen logo

About HeyGen

Free AI Video Generator: Create Stunning Videos with AI

Create AI videos from your ideas using HeyGen. Input text, image, or audio to create complete videos with narration, captions, visuals, and animations.

AI video generatorAI avatarstext-to-videoimage-to-videovoice cloninglip-syncvideo translationlocalization
Company profileWebsite

More open roles at HeyGen