← All roles

Senior Software Engineer - Systems

Boson AI· Engineering
Apply on company site
Santa Clara, CA$180k - $400kFull-timePosted 2mo ago

About the role

Build and operate the core platform behind Boson's model APIs and agentic products, owning the infrastructure that every Boson agent runs on including API serving, state management, data pipelines, context retrieval, and execution runtime.

Responsibilities

  • Own and evolve the core platform infrastructure: API serving layer, state management, policy enforcement engine, and execution runtime for agentic workflows.
  • Design and operate high-throughput, low-latency distributed services that back our model API products — including request routing, load management, rate limiting, and multi-tenant isolation.
  • Build and maintain downstream data pipelines (ETL/ELT) for API logs, usage analytics, and billing — ensuring data correctness, freshness, and queryability at scale.
  • Develop production-grade internal SDKs and libraries with clean APIs, strong type safety, and clear contracts that product teams can build on confidently.
  • Architect context and memory systems for conversational workloads — low-latency retrieval, caching, and integration with vector stores and retrieval pipelines.
  • Instrument end-to-end observability: define SLIs/SLOs, build structured logging and tracing, and drive reliability improvements across the platform.
  • Collaborate closely with ML and product teams to integrate model serving, voice runtime, and tooling infrastructure under tight latency and quality constraints.

Qualifications

  • 3+ years building and operating backend systems at scale — you've owned services that other teams depend on in production.
  • Strong distributed systems fundamentals: concurrency, fault tolerance, consistency tradeoffs, capacity planning.
  • Hands-on experience with data pipeline infrastructure (Kafka/Kinesis, Spark/Flink, Airflow, or similar) for log processing, analytics, or ETL workloads.
  • Track record of designing APIs and frameworks adopted by other engineering teams — you care about developer experience and long-term maintainability.
  • Proficiency in at least one systems language (Go, Rust, Java, C++) or Python in a performance-sensitive context.
  • Comfortable working across the stack: cloud infrastructure (AWS/GCP), containerized deployments (K8s), CI/CD, and production oncall.

Skills

Required:Backend system designDistributed systemsData pipelinesAPI designSystems programming
Last updated Aug 10, 2026. Interested? Apply on the company site.
Boson AI logo

About Boson AI

Boson AI | AI for Humans

Boson AI builds voice agents for business-critical work — speech-to-speech models, real-time avatars, and production TTS in 100+ languages.

Higgs RealtimeHiggs Audio / AvatarBoson WorkspaceEnterprisesVoice experienceAPI DocsAPI ReferencePricing
Company profileWebsite

More open roles at Boson AI