Member of Technical Staff, Product Engineer/Full Stack
San FranciscoFull-timePosted 3mo ago
About the role
Judgment Labs is building infrastructure for continual learning in long-horizon AI agents, turning long trajectories into structured data for evals, labeling, rubric generation, context engineering, and RL workflows. The role involves end-to-end ownership: talking to customers, defining what to build, building it, and iterating until it’s great.
Responsibilities
- Investigation interfaces: Design how engineers understand what their systems did and why. Long traces, tool calls, decisions, failures. Make complex sequences legible in minutes.
- Verification: Build the platform for verifying system changes: hosted simulated environments, trajectory replay, and monitors for unintended behavior changes.
- The improvement loop: Build the workflows that turn production data into datasets, evaluations, and regression checks, so the path from 'found a problem' to 'verified a fix' feels like one motion.
- The platform underneath: Workspaces, roles, permissions, billing, usage, and limits for teams running many workflows across many environments.
Qualifications
- 5+ years of experience building and scaling end-to-end production systems, from data layer to UI.
- Strong technical problem-solving skills, especially in fast-changing, ambiguous environments.
- A builder and tinkerer's mindset with high agency - you find creative ways to overcome obstacles and ship.
- Comfort working directly with customers to understand their needs and solve real-world problems.
- Excellent communication skills - clear, direct, and persuasive across technical and non-technical audiences.
Last updated Oct 25, 2026. Interested? Apply on the company site.
About Judgment Labs
The continuous-improvement stack for agents.
The continuous-improvement stack for agents. Monitor and improve your agent's behavior at scale.
AIJudgmentLabsagentbessemer-ai-infrastructure-2026harness-infrastructureproductiontrust
More open roles at Judgment Labs
- Member of Technical Staff, Agents2mo agoSan Francisco · Engineering
- Member of Technical Staff, Backend/Infrastructure3mo agoSan Francisco · Engineering
- Member of Technical Staff, Deployment Engineer3mo agoSan Francisco · Engineering