Member of Technical Staff, Performance Optimization
San Mateo, CA$175k - $220kFull-timePosted 11mo ago
About the role
Software Engineer focused on performance optimization to enhance speed and efficiency across AI infrastructure, from low-level GPU kernels to large-scale distributed systems, enabling faster and more cost-effective production AI for LLMs, VLMs, and video models.
Responsibilities
- Optimize system and GPU performance for high-throughput AI workloads across training and inference
- Analyze and improve latency, throughput, memory usage, and compute efficiency
- Profile system performance to detect and resolve GPU- and kernel-level bottlenecks
- Implement low-level optimizations using CUDA, Triton, and other performance tooling
- Drive improvements in execution speed and resource utilization for large-scale model workloads (LLMs, VLMs, and video models)
- Collaborate with ML researchers to co-design and tune model architectures for hardware efficiency
- Improve support for mixed precision, quantization, and model graph optimization
- Build and maintain performance benchmarking and monitoring infrastructure
- Scale inference and training systems across multi-GPU, multi-node environments
- Evaluate and integrate optimizations for emerging hardware accelerators and specialized runtimes
Qualifications
- Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience
- 5+ years of experience working on performance optimization or high-performance computing systems
- Proficiency in CUDA or ROCm and experience with GPU profiling tools (e.g., Nsight, nvprof, CUPTI)
- Familiarity with PyTorch and performance-critical model execution
- Experience with distributed system debugging and optimization in multi-GPU environments
- Deep understanding of GPU architecture, parallel programming models, and compute kernels
Skills
Required:CUDAGPU profilingPyTorchDistributed systems
Benefits
- Total compensation includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package
- Base Pay Range (Plus Equity): $175,000—$220,000 USD
Last updated Jul 29, 2026. Interested? Apply on the company site.
About Fireworks AI
Fastest Inference for Generative AI
Use state-of-the-art, open-source LLMs and image models at blazing fast speed, or fine-tune and deploy your own at no additional cost with Fireworks AI!
Generative AIImageLLMMultimediaSearchai-infrastructure-and-developmentliquid-ai-recruiting-targetllm
More open roles at Fireworks AI
- Technical Account Manager, Enterprise2mo agoHybrid (London, UK; New York, NY; San Mateo, CA) · Go To Market
- AI Field Engineer, Singapore2mo agoHybrid (Singapore) · Go To Market
- Enterprise Account Executive, EMEA2mo agoHybrid (London, UK) · Go To Market
- Applied Machine Learning Engineer, EMEA2mo agoHybrid (London) · Engineering
- Enterprise Account Executive, Singapore2mo agoSingapore · Go To Market