← All roles

Research Engineer - Pretraining

Prime Intellect· Research
Apply on company site
San Francisco, Remote$150k - $350kFull-timePosted 4d ago

About the role

Take Prime Intellect’s next open models from architecture experiments through full pretraining runs, scaling toward 1–3T parameters. You’ll work across the model and training stack, making research decisions and fixing the systems problems that determine whether a run succeeds.

Responsibilities

  • Build and extend the pretraining code in prime-rl, taking small experiments into full training runs.
  • Evaluate model architecture changes, including MoE and attention designs, against model quality and training cost.
  • Profile training jobs and improve end-to-end throughput, working with systems engineers on hardware-aware execution.
  • Make long runs resilient to failures, with reliable checkpointing and recovery.
  • Investigate training dynamics and numerical stability, checking that optimizations preserve convergence.
  • Run controlled ablations to guide larger experiments, keeping the setup and results reproducible.
  • Work with data and evaluation researchers on training mixtures, including midtraining and long-context experiments.

Qualifications

  • Hands-on experience training language models, including modifying training code and following the effects through actual runs.
  • Strong Python skills and experience with PyTorch or a comparable framework, with enough systems understanding to debug distributed training.
  • A practical understanding of model architectures and optimization, including their effect on convergence.
  • Ability to design an ablation that answers a research question and explain what its results do and don’t show.
  • Good judgment about what to investigate yourself and when to bring in a colleague.

Skills

Required:Language model trainingPythonPyTorch or equivalentSystem debugging for distributed trainingAblation design

Benefits

  • Cash Compensation Range of $150-350k, including equity incentives, aligning your success with the growth and impact of Prime Intellect.
  • Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences and learning opportunities.
  • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Prime Intellect

Commoditizing Compute & Intelligence

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

AI developmentbessemer-ai-infrastructure-2026compute resourcesdistributed trainingmodelsreinforcement-learning-platformsscience
Company profileWebsite

More open roles at Prime Intellect