Mid-training
xAI· Model
Hybrid (Palo Alto, CA)$180k - $440kPosted 11mo ago
About the role
SpaceXSI mid-training role focusing on scaling and optimizing synthetic data and evaluation for mid-training AI models.
Responsibilities
- Scale synthetic coding data to trillions of tokens with large-scale docker verification.
- Distill the intelligence of flagship models into flash models through synthetic data generation.
- Optimize mid-training data mixtures to boost the ceiling for RL.
- Engineer long-context data recipes.
- Develop robust and diverse evaluation for mid-training checkpoints.
Qualifications
- Expertise in ML and large model scaling, with familiarity across all kinds of scaling laws.
- Strong ability to design ML experiments.
- Familiarity with state-of-the-art techniques for curating AI training data for text, image, audio, and video modalities.
- Strong engineering abilities in Spark, Ray, and other frameworks for large-scale data processing.
Skills
Required:ML and large model scalingML experiment designAI training data curation (multimodal)Large-scale data processing (Spark, Ray)
Benefits
- equity, comprehensive medical, vision, and dental coverage
- access to a 401(k) retirement plan
- short & long-term disability insurance
- life insurance
- various other discounts and perks
Last updated Oct 21, 2026. Interested? Apply on the company site.
More open roles at xAI
- Supervisor, Child Safety Operations4d agoAustin, TX · Safety
- Security Engineer, Kubernetes4d agoHybrid (Palo Alto, CA; Austin, TX; New York, NY; Washington, DC) · Information Security
- Security Engineer - GRC Sales4d agoInformation Security
- Site Reliability Engineer4d agoHybrid (Memphis/Southaven) · Data Center
- Senior Linux Data Center Technician - Memphis4d agoHybrid (Memphis, TN) · Data Center