Member of Technical Staff, Deployment Engineer
San Francisco$0Full-timePosted 3mo ago
About the role
Judgment Labs is building the infrastructure for continual learning in long-horizon AI agents. This role focuses on end-to-end customer engagements, technical deployment, and translating customer feedback into product direction.
Responsibilities
- Partner with AEs on technical sales: run discovery and demos, answer product questions, and show prospects how Judgment fits their agents.
- Deploy and embed Judgment Labs' ABM platform and AI components into customer codebases and production AI systems, integrating monitoring and evaluation into real workflows.
- Guide customers through technical decisions around agent monitoring, evaluation strategy, and integrating these capabilities into existing production systems.
- Own multiple customer engagements end-to-end, from the first technical conversation through successful integration and sustained adoption, in Slack and on calls.
- Turn feedback across customers into product direction: what to build, what to fix, and what not to build.
- Prototype and demo new features with coding agents, ship PRs when it makes sense, and work with engineering to get the right changes shipped.
Qualifications
- Experience deploying AI or LLM-based systems into real production environments.
- Ability to quickly learn new tools and systems, and integrate AI infrastructure into existing customer workflows and codebases.
- Ability to translate ambiguous customer goals into concrete technical solutions and evaluation strategies.
- Strong product sense: you can hear what a customer asks for, find the problem underneath, and explain clearly what's worth building.
- Comfort prototyping and shipping changes quickly with coding agents.
- Strong customer-facing skills, including explaining complex technical concepts clearly and building trust with both technical and non-technical stakeholders.
- Comfort owning customer engagements end-to-end, from the first call through successful production adoption.
- You want to be a technical founder in the future.
Skills
Required:Deploying AI/LLM-based systems in productionTechnical sales support and demosCustomer engagement ownershipProduct feedback and directionPrototyping and coding with agents
Benefits
- Full benefits
- Equinox
- private chef
- Smash/Mario Kart tournaments (company culture)
Last updated Oct 25, 2026. Interested? Apply on the company site.
About Judgment Labs
The continuous-improvement stack for agents.
The continuous-improvement stack for agents. Monitor and improve your agent's behavior at scale.
AIJudgmentLabsagentbessemer-ai-infrastructure-2026harness-infrastructureproductiontrust
More open roles at Judgment Labs
- Member of Technical Staff, Agents2mo agoSan Francisco · Engineering
- Member of Technical Staff, Product Engineer/Full Stack3mo agoSan Francisco · Engineering
- Member of Technical Staff, Backend/Infrastructure3mo agoSan Francisco · Engineering