← All roles

AI Agent Engineer

CollectWise· Engineering
Apply on company site
New York City, NY$150k - $250kFull-timePosted 2mo ago

About the role

AI Agent Engineer role at CollectWise to build the infrastructure, prompting systems, and core architecture behind voice AI agents, focusing on real-time orchestration, prompting, testing, and performance optimization to scale millions of voice interactions.

Responsibilities

  • Build our voice AI infrastructure in LiveKit
  • Design and own the architecture of our real-time voice agent systems, including orchestration, state management, latency optimization, prompting and reliability.
  • Own the end-to-end prompting strategy for CollectWise voice agents, including conversation flows, tone, compliance-safe phrasing, guardrails, and edge-case handling.
  • Build and maintain testing and evaluation frameworks for voice agent performance, including A/B testing, regression testing, conversation QA, benchmarking, and KPI reporting.
  • Write, expand, and improve our core AI prompting to cover more real-world scenarios.
  • Continuously iterate based on performance data, call outcomes, and customer feedback to improve containment, conversion, liquidation rates, and customer satisfaction.
  • Optimize ASR, STT, TTS, turn-taking, interruption handling, and state transitions to improve voice quality and agent performance.
  • Build scalable systems and tooling to support millions of voice interactions.
  • Migrate client implementations from legacy voice AI infrastructure to the latest systems you build, while preserving client-specific customizations and workflows.
  • Develop prompt and agent tooling, including versioning, rollout strategies, monitoring, safety checks, and debugging workflows.
  • Work closely with product, operations, and leadership to translate business goals into high-performing voice agent behavior.

Qualifications

  • 2+ years of experience in voice AI, conversational AI, prompt engineering, speech systems, or related agentic workflows.
  • 3+ years of experience in platform, infrastructure, or backend engineering.
  • Strong experience with Node.js, AWS, and SQL.
  • Experience building and shipping production systems in a startup or similarly fast-paced environment.
  • Experience with voice orchestration platforms or agent frameworks such as LiveKit.
  • Strong prompt writing instincts and the ability to design clear, effective, and resilient conversational flows.
  • Strong analytical skills and comfort tying technical work directly to business outcomes and ROI.
  • Excellent communication skills, high ownership, and a strong work ethic.

Skills

Required:Voice AI / Conversational AIPrompt engineeringNode.jsAWSSQL
Last updated Sep 16, 2026. Interested? Apply on the company site.
CollectWise logo

About CollectWise

Automating consumer debt collection with AI

CollectWise automates consumer debt collection with AI. Our platform allows creditors and agencies to double their recovery rates while reducing collection costs by 75%.

Company profileWebsite

More open roles at CollectWise