← All roles

Research Engineer - Inference

Prime Intellect· Research
Apply on company site
San Francisco, Remote$150k - $350kFull-timePosted 5d ago

About the role

Build the inference systems powering Prime Intellect’s RL research, scaling toward 1–3T parameter models on NVL72 clusters to improve rollout throughput and enable frequent model updates.

Responsibilities

  • Extend prime-rl’s vLLM integration to bring new model architectures into RL training, with small-scale validation before larger runs.
  • Improve rollout throughput for long-horizon agents, tuning concurrency and KV-cache reuse as context lengths grow.
  • Optimize multi-node MoE inference, including expert parallelism and the tradeoffs of separating prefill from decode.
  • Reduce trainer-to-inference weight-update overhead through sharding-aware transfer and communication overlap, while keeping rollout workers on the intended policy version.
  • Build on FP8 and evaluate lower precision. Use trainer/sampler mismatch checks to catch numerical regressions and measure the effect on RL training.
  • Work with model researchers on architecture choices that improve inference efficiency, balancing model quality against execution cost on the target hardware.

Qualifications

  • Experience building or optimizing GPU inference systems, with an understanding of inference-engine internals.
  • Strong Python skills and experience with PyTorch or a comparable ML framework.
  • Ability to profile end-to-end workloads and turn measurements into verified performance improvements.
  • Experience debugging numerical or integration issues in ML systems.

Skills

Required:GPU inference systemsPythonPyTorchProfiling & optimizationDebugging ML systems

Benefits

  • Cash Compensation Range of $150-350k, including equity incentives, aligning your success with the growth and impact of Prime Intellect.
  • Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences and learning opportunities.
  • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Prime Intellect

Commoditizing Compute & Intelligence

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

AI developmentbessemer-ai-infrastructure-2026compute resourcesdistributed trainingmodelsreinforcement-learning-platformsscience
Company profileWebsite

More open roles at Prime Intellect