← All roles

Member of Technical Staff - Platform

Vals AI· Engineering & Research
Apply on company site
San Francisco$130k - $185kFull-timePosted 3mo ago

About the role

Engineer to own and scale the platform for running benchmarks, including Python libraries, a web platform, distributed systems, and cloud infrastructure. Autonomy in tech stack decisions, with collaboration across research and engineering to evaluate LLMs at scale.

Responsibilities

  • Build distributed systems to run evaluations across multiple models, benchmarks, and machines at scale
  • Deploy cloud infrastructure using IAC, including deployment pipelines, servers, logging, monitoring, etc.
  • Contribute to the internal and external libraries we maintain, including our public model library
  • Develop full-stack features for our platform using React/TypeScript on the frontend and Python/Django on the backend
  • Perform code and architecture reviews for other members of the team
  • Help establish engineering best practices across the organization
  • Collaborate closely with the research team to ensure our infrastructure meets their needs

Qualifications

  • Strong engineering fundamentals
  • Python expertise
  • System Design Experience
  • Familiarity with LLMs
  • Team collaboration
  • Communication
  • Comfort with Ambiguity
  • Iteration speed
  • Location: in-person team based in San Francisco; relocation/ transportation support provided

Skills

Required:Strong engineering fundamentalsPythonSystem designLLMs

Benefits

  • Relocation and transportation support
  • Health/dental insurance coverage
  • Lunch and dinner provided, free snacks/coffee/drinks
  • 401K plan
  • Unlimited PTO
  • $1,500 housing stipend (within one-mile radius)
  • Highly competitive salary and meaningful ownership
Last updated Oct 18, 2026. Interested? Apply on the company site.

About Vals AI

Private, domain-specific benchmarks in legal, tax, and finance.

financelawsoftwarehealthcarebenchmarksVals IndexSWE-benchTaxEval

More open roles at Vals AI