← All roles

Member of Technical Staff (Inference)

Artificial Analysis· Technical Staff (incl. Product)
Apply on company site
San Francisco (On-site)Full-timePosted 1mo ago

About the role

Member of Technical Staff focusing on AI model inference benchmarking and analysis to cover serverless inference landscapes, extend benchmarking methodology, and shape product direction.

Responsibilities

  • Benchmark the Inference Landscape: Own performance and price coverage of serverless API inference across the provider ecosystem, from frontier labs to specialist providers
  • Extend Our Methodology: Drive new benchmarking dimensions including cached pricing, endpoint accuracy and agentic performance, keeping our measurement ahead of how the industry deploys
  • Partner with Providers: Work directly with inference providers and neoclouds to benchmark their endpoints, resolve methodology questions and shape how the market measures serving performance
  • Analyze the Market: Produce the analysis the industry uses to understand inference performance and economics, from throughput and time-to-first-token to price-performance frontiers
  • Drive Product Direction: Shape the roadmap of our inference benchmarking platform together with our engineers and pillar lead
  • Become AI-Native: Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking

Qualifications

  • 3+ years of professional experience, including at least 2 years at, or working closely with, inference providers, neoclouds or teams serving models in production
  • Strong analytical and critical thinking skills
  • Proficiency in Python and data analysis
  • Hands-on familiarity with the model serving stack (e.g. vLLM, SGLang, TensorRT-LLM) and inference APIs across providers
  • Fluency in inference performance metrics and economics: tokens per second, time to first token, throughput versus latency trade-offs, cost per token
  • Genuine, demonstrable interest and knowledge of Frontier AI

Skills

Required:PythonData analysisModel serving stackInference performance metricsFrontier AI knowledge

Benefits

  • Competitive compensation including equity
Last updated Oct 1, 2026. Interested? Apply on the company site.

About Artificial Analysis

Independent analysis of AI

AI ModelAPI ProvidersAnalysisBenchmarkingIndependenceEvaluationIntelligence IndexLeaderboards
Company profileWebsite

More open roles at Artificial Analysis