← All roles

Senior | Staff Software Engineer - AI / ML

Snorkel AI· 312 - Engineering
Apply on company site
Hybrid (San Francisco, CA)$208k - $315kfull-timePosted 3w ago

About the role

Senior/Staff Software Engineer focused on frontier AI data and ML tooling to accelerate evaluation, routing, and production-quality AI workloads at Snorkel AI.

Responsibilities

  • Efficient agentic evals. Cut the cost of long-horizon agent evaluation with adaptive sampling, statistically grounded early stopping, model cascades, caching, and cheap-first gating.
  • AI model routing. Route every eval and judge call to the cheapest model that clears the quality bar, with fallback, monitoring, and cost attribution.
  • Fine-tuned small models. Fine-tune and serve open-weight models (LoRA and other parameter-efficient methods) where they match frontier quality, and know when they don't.
  • Predictive difficulty. Build models that estimate how hard a task is for frontier systems before running a single rollout.
  • Measurement for AI data. Build golden datasets, quantify the accuracy and calibration of LLM-as-judge systems, and make quality reproducible across projects.
  • Research to production. Turn research prototypes into reusable, configurable components that forward deployed engineers and researchers use on every project.

Qualifications

  • 5+ years building production ML or software systems, with end-to-end ownership from prototype to production
  • Hands-on experience running LLM or ML workloads in production, and comfort reasoning about non-deterministic systems
  • Deep grounding in statistics and experimentation: experiment design, hypothesis testing, sampling, and confidence intervals
  • Strong Python and software engineering fundamentals, including testing, code review, and system design
  • Experience designing evaluations and interpreting results rigorously
  • A habit of finding high-impact problems before they are assigned, and clear communication with researchers, engineers, and business partners

Skills

Required:Production ML/Software EngineeringLLM/ML workloads in productionStatistics and experimentationPython & software engineering fundamentalsEvaluation design and interpretation
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Snorkel AI

Shaping how AI learns through better data

Snorkel AI delivers the highest quality specialized datasets for frontier LLMs and enterprise models.

AI data development servicesAboutApplied AI solutionsCareersCompanyContact usCustomer storiesData development services
Company profileWebsite

More open roles at Snorkel AI