← All roles

AI Engineer, Model Quality and Performance

Cerebras· Software Engineering
Apply on company site
Sunnyvale, CAFull-timePosted 3mo ago

About the role

Role focused on owning model quality and performance for Cerebras' inference offerings by defining what “good” looks like, building AI-driven evaluation systems, and generating artifacts for customers and product teams.

Responsibilities

  • Design eval suites with AI agents in the loop. For every model release, curate a mix of advanced, basic, long-context, and customer-use-case-specific evals. Use Claude to generate, validate, and prune candidate test cases at speed.
  • Build custom evals for target customers by orchestrating AI agents to mine trajectories from their workloads and synthesize representative eval sets.
  • Automate eval execution end-to-end with AI-driven pipelines on top of standard tooling (Docker, Git, CI).
  • Build automations to forecast and benchmark model performance on Cerebras for our top customers, including modeling how fast customer-specific workloads will run in production.
  • Build product-quality tooling that synthesizes quality + performance data into a single, easy-to-use view.

Qualifications

  • Experience building AI agents. You ship real systems with Claude (or equivalent) as a force multiplier.
  • Strong math/stats background.
  • Comfort with Docker, Git, and the standard automation stack.
  • A taste for tooling design. You've shipped something that a non-engineer used without complaining. Bonus if AI helped you ship it.

Skills

Required:AI agents in software systemsMath and statisticsDockerGit
Nice to have:Tooling designEval framework familiarity
Last updated Aug 30, 2026. Interested? Apply on the company site.

About Cerebras

Cerebras is the go-to platform for fast and effortless AI training. Learn more at cerebras.ai.

Cerebras is the go-to platform for fast and effortless AI training.

AICerebras Wafer-Scale Enginechipshardwareinferenceliquid-ai-recruiting-targetmultimodalsetter-30
Company profileWebsite

More open roles at Cerebras