← All roles

Software Engineer, AI

Respan
Apply on company site
Hybrid (Alameda, CA, US)$1k - $200kFull-timePosted 3mo ago

About the role

Open-source, extensible AI gateway with observability and evals. Role focuses on building production-grade AI systems, including evals, prompt optimization, model routing, and AI-powered analysis of traces and logs for Respan.

Responsibilities

  • Design and build AI-powered features including eval frameworks and prompt optimization
  • Develop LLM-as-judge pipelines for automated quality assessment
  • Build and maintain model routing, caching, and fallback systems
  • Experiment with new model capabilities and translate them into product features
  • Collaborate with customers to understand AI workflow pain points and build solutions

Qualifications

  • Strong software engineering skills with Python and TypeScript
  • Hands-on experience building with LLMs in production (not just prototypes)
  • Deep understanding of prompt engineering, eval methodologies, and model behavior

Skills

Required:PythonTypeScriptLLMs in productionPrompt engineering
Nice to have:Model routingObservability toolsOpen-source contributions
Last updated Oct 25, 2026. Interested? Apply on the company site.
Respan logo

About Respan

Self-driving observability, evals, and gateway for AI agents

Respan (formerly Keywords AI) gives teams a unified control plane to trace and evaluate agent behavior without guesswork, automatically surface issues, and fix what breaks faster. Respan connects production observability, automated and human-in-the-loop evaluations, and an adaptive AI gateway to close the loop between detection, decision, and action - so agents improve continuously in production. Respan is trusted by 100+ AI startups and enterprise teams. Today, the platform process 1B+ logs and 2T+ tokens every month, supporting more than 6.5M end users.

AIOpsArtificial IntelligenceDeveloper ToolsSaaSMonitoring
Company profileWebsite

More open roles at Respan