Research Engineer, Training & Inference
Palo Alto$200k - $450kFull-timePosted 3mo ago
About the role
Engineer responsible for architecture and optimization of Harmonic's proprietary RL training and serving infrastructure, with a focus on maximizing throughput for reinforcement learning and production workflows across the full stack from Python APIs to CUDA kernels.
Responsibilities
- Total Stack Ownership: Maintain and optimize our proprietary RL training and serving infrastructure. You have the authority to refactor any layer—from the Python API down to the CUDA kernels—to achieve peak performance for foundation model workloads.
- Optimized Training: maximize the throughput of our reinforcement learning system from data generation to model training with sharded multi-node training and inference algorithms.
- High-Performance Serving: optimize our inference stack for high-throughput reinforcement learning and low-latency LLM production traffic. Tune the inference engine, router, and scheduler, down to custom kernels if need be.
- Compute Optimization: Identify and resolve performance bottlenecks within our distributed clusters, ensuring optimal throughput and memory efficiency for multi-billion parameter models, balancing memory constraints with compute-heavy training cycles.
Qualifications
- BS in Computer Science or a related technical field, or equivalent industry experience
- 2+ years of relevant, hands-on industry experience
- Proficiency in Python
- Experience building or maintaining components within ML frameworks (e.g., PyTorch, JAX, or TensorFlow)
- Proficiency in either: Understanding of distributed training concepts and collective communication primitives (e.g., NCCL) OR Practical experience deploying and profiling models on GPU-accelerated cloud infrastructure.
Skills
Required:Python
Benefits
- Unlimited PTO
- 401(k) matching
- 100% employer-paid health, vision, and dental benefits for employees and 50% coverage for dependents. Harmonic offers varied health coverage options to select what is best for you and your family.
- Health Savings Account (HSA) available for qualifying health plans
Last updated Aug 4, 2026. Interested? Apply on the company site.
About Harmonic
Mathematical Superintelligence
Mathematical Superintelligence
HarmonicMathematicalSuperintelligenceliquid-ai-recruiting-target
More open roles at Harmonic
- Research Engineer, Formal Methods2mo agoPalo Alto, London · Engineering
- Formal Verification Engineer2mo agoPalo Alto, London · Engineering
- Software Engineer, Product2mo agoPalo Alto · Engineering
- Software Engineer, ML Systems3mo agoPalo Alto · Engineering
- Research Engineer3mo agoPalo Alto · Engineering