← All roles

Research Engineer - Language Model Pre-Training

Zyphra· R&D - Engineering
Apply on company site
San FranciscoFull-timePosted 11mo ago

About the role

Role focused on shaping the language model roadmap through end-to-end pretraining development, collaborating closely with the pretraining team to influence next-generation models.

Responsibilities

  • Large-scale training runs and model parallelization
  • Performance optimization of our pretraining stack
  • Dataset collection, processing, and evaluation
  • Architecture and methodology research, including optimizer ablations

Qualifications

  • Deep expertise and intuition for solving machine learning problems and training models
  • Experience with training on large-scale (multi-node) GPU clusters
  • Deep understanding of model training pipelines – including model/data parallelism, distributed optimizers, etc.
  • Strong grasp of proper experimental methodology for running rigorous ablations and other hypothesis testing
  • Understanding of large-scale, highly parallel data processing pipelines
  • High proficiency with PyTorch and Python
  • Strong ability to dive into large pre-existing codebases and rapidly get up to speed
  • Postgraduate degree in a scientific subject (Computer Science, EE/EECS, Math, Physics)

Skills

Required:Large-scale ML model trainingModel/data parallelismExperimentation and ablation methodologyPyTorchPython

Benefits

  • Comprehensive medical, dental, vision, and FSA plans
  • Competitive compensation and 401(k) plan
  • Relocation and immigration support on a case-by-case basis
  • In-office snacks and meals provided
  • Unlimited PTO and company holidays
  • In-person team in San Francisco with a collaborative, high-energy environment
Last updated Aug 6, 2026. Interested? Apply on the company site.

About Zyphra

Zyphra Technologies Inc.

Company profileWebsite

More open roles at Zyphra