Research Engineer - Model Architectures
Zyphra· R&D - Engineering
San FranciscoFull-timePosted 11mo ago
About the role
Research Engineer focused on designing and rigorously testing novel model architectures and training methodologies to improve core modeling capabilities and address bottlenecks in contemporary models, closely collaborating with the pre-training team.
Responsibilities
- Design and rigorously test novel model architectures and training methodologies
- Focus on improving core modeling capabilities (e.g., loss per flop or loss per parameter)
- Address fundamental bottlenecks in contemporary models
- Collaborate extremely closely with the pre-training team to integrate insights into next-generation models
Qualifications
- Postgraduate degree in Computer Science, EE/EECS, Math, Physics
- Previous published machine learning research in well-respected venues
- High proficiency with PyTorch and Python
- Strong implementation and prototyping ability to take an idea from conception to experimentation quickly
- Ability to work through a research project from conception to execution to write-up
- Experience jumping into large pre-existing codebases and becoming productive
- Understanding of modern training pipelines and hardware requirements to design efficient architectures for GPU hardware
- Strong grasp of experimental methodology for rigorous ablations and hypothesis testing
- Experience with long-term memory, RAG/retrieval systems, dynamic/adaptive computation, and credit assignment approaches
- Experience with reinforcement learning, control theory, and signal processing
- A joy in inventing and seriously assessing ‘crazy’ ideas with a unique perspective
- Ability to work well in a high-paced research setting
Skills
Required:Research planning and project executionPrototypingPyTorchPythonExperimental methodologyGPU architectures & training pipelines
Nice to have:Reinforcement learningLong-term memory / RAG / retrieval systems
Benefits
- Comprehensive medical, dental, vision, and FSA plans
- Competitive compensation and 401(k) plan
- Relocation and immigration support on a case-by-case basis
- In-office snacks and meals provided
- Unlimited PTO and company holidays
- In-person team in San Francisco with a collaborative, high-energy environment
Last updated Aug 6, 2026. Interested? Apply on the company site.
More open roles at Zyphra
- Machine Learning Systems Administrator / DevOps Engineer: Training Clusters & Inference Cloud4d agoSan Francisco · R&D - Engineering
- Research Engineer -- Vision and Vision-Language Models4d agoSan Francisco · R&D - Engineering
- Principal Solutions Architect7mo agoSan Francisco · GTM
- Developer Relations Lead7mo agoSan Francisco · GTM
- GTM Engineer7mo agoSan Francisco · GTM