Member of Technical Staff - Platform
Vals AI· Engineering & Research
San Francisco$130k - $185kFull-timePosted 3mo ago
About the role
Engineer to own and scale the platform for running benchmarks, including Python libraries, a web platform, distributed systems, and cloud infrastructure. Autonomy in tech stack decisions, with collaboration across research and engineering to evaluate LLMs at scale.
Responsibilities
- Build distributed systems to run evaluations across multiple models, benchmarks, and machines at scale
- Deploy cloud infrastructure using IAC, including deployment pipelines, servers, logging, monitoring, etc.
- Contribute to the internal and external libraries we maintain, including our public model library
- Develop full-stack features for our platform using React/TypeScript on the frontend and Python/Django on the backend
- Perform code and architecture reviews for other members of the team
- Help establish engineering best practices across the organization
- Collaborate closely with the research team to ensure our infrastructure meets their needs
Qualifications
- Strong engineering fundamentals
- Python expertise
- System Design Experience
- Familiarity with LLMs
- Team collaboration
- Communication
- Comfort with Ambiguity
- Iteration speed
- Location: in-person team based in San Francisco; relocation/ transportation support provided
Skills
Required:Strong engineering fundamentalsPythonSystem designLLMs
Benefits
- Relocation and transportation support
- Health/dental insurance coverage
- Lunch and dinner provided, free snacks/coffee/drinks
- 401K plan
- Unlimited PTO
- $1,500 housing stipend (within one-mile radius)
- Highly competitive salary and meaningful ownership
Last updated Oct 18, 2026. Interested? Apply on the company site.
About Vals AI
Private, domain-specific benchmarks in legal, tax, and finance.
financelawsoftwarehealthcarebenchmarksVals IndexSWE-benchTaxEval
More open roles at Vals AI
- Child & Adolescent Physician / Developmental Expert (Contract)todayRemote · Engineering & Research
- Member of Technical Staff - Research, AI SafetytodaySan Francisco · Engineering & Research
- Member of Technical Staff - Research, CybertodaySan Francisco · Engineering & Research
- Technical Content Lead3w agoSan Francisco · Communications
- Marketing Designer1mo agoSan Francisco · Design