Evaluation Infrastructure
xAI· Engineering
Palo Alto, CA$180k - $440kfull-timePosted 2w ago
About the role
Engineer to help develop and scale SpaceXSI's evaluation infrastructure, collaborating with modeling and evaluation teams to maintain signal quality and build internal tooling for training next-generation models.
Responsibilities
- Build highly reliable, efficient, and easy to use infrastructure that runs all evaluations at scale
- Collaborate closely with modeling & evaluation teams on developing new evals, maintaining evaluation signal quality, and building internal tooling to support training our next-generation of models
- Identify and resolve performance bottlenecks in all layers of the eval infrastructure stack, including inference, capacity fleet management, asynchronous eval orchestration, and more
Qualifications
- Experience in building, debugging, and optimizing efficiency of large-scale distributed systems
- Willingness to dive deep and solve hard problems at all levels of the stack
Skills
Required:Distributed systemsDeep debugging and optimization
Nice to have:LLM inferenceGPU compute managementModel/eval interfaces
Benefits
- equity
- comprehensive medical, vision, and dental coverage
- access to a 401(k) retirement plan
- short & long-term disability insurance
- life insurance
- various other discounts and perks
Last updated Oct 21, 2026. Interested? Apply on the company site.
More open roles at xAI
- Supervisor, Child Safety Operations6d agoAustin, TX · Safety
- Security Engineer, Kubernetes6d agoHybrid (Palo Alto, CA; Austin, TX; New York, NY; Washington, DC) · Information Security
- Security Engineer - GRC Sales6d agoInformation Security
- Site Reliability Engineer6d agoHybrid (Memphis/Southaven) · Data Center
- Senior Linux Data Center Technician - Memphis6d agoHybrid (Memphis, TN) · Data Center