Senior Software Engineer, Backend Systems
Distributed Spectrum· Engineering
New York City$180k - $220k + equityFull-timePosted 2w ago
About the role
Senior Backend Engineer role focused on designing and building the core backend services for the Distributed Spectrum platform, including data ingestion, ML inference orchestration, and evolving the system into an agent-native architecture.
Responsibilities
- Design, build, and operate backend services that are reliable, observable, and built to scale with our sensor fleet and customer base.
- Architect the agent layer of our platform: tool-calling interfaces, orchestration, state management, memory, and evaluation harnesses for LLM- and model-driven agents.
- Own the ML inference architecture — model serving, batching, GPU/CPU scheduling, latency and cost optimization, and the APIs that expose inference to the rest of the system.
- Define service boundaries, data contracts, and API standards across the backend.
- Build for production: instrumentation, alerting, graceful degradation, and clear runbooks.
- Partner closely with ML researchers to move models from experiment to production quickly and safely.
- Lead design reviews, mentor engineers, and raise the bar on code quality and engineering practice.
Qualifications
- 4–6+ years of professional software engineering experience, with significant time spent building and running backend / distributed systems in production.
- Strong proficiency in at least one of Python, Go, Rust, or a similar systems-capable language; comfort moving between languages.
- Hands-on experience with AWS or another major cloud provider (GCP, Azure) — compute, networking, storage, IAM, and managed data services.
- Experience building or integrating LLM / agent systems: tool use, orchestration frameworks, RAG, evaluation, or comparable work.
- Experience serving ML models in production (e.g., Triton, TorchServe, vLLM, custom serving) and reasoning about throughput, latency, and cost.
- Deep understanding of APIs (REST / gRPC), async processing, message queues / streaming (Kafka, SQS, Kinesis, etc.), and data consistency trade-offs.
- Track record of owning systems end to end and making architecture decisions with long-lived consequences.
Skills
Required:Backend software engineeringPythonGo / Rust / systems languageCloud platformsLLM / agent systemsML model serving
Benefits
- Above-market salary, equity, and benefits package.
- Early Series A Equity
- Excellent health, dental, and vision coverage
- 401(k) match - up to 4% of your salary
- Flexible PTO
- Daily office lunches in NYC
Last updated Oct 7, 2026. Interested? Apply on the company site.
About Distributed Spectrum
The World’s First AI Signals Expert
Gain actionable insights from the radio spectrum in real-time with small, cheap and efficient sensors from Distributed Spectrum
radio spectrumsensorsAI signalsthreat detection
More open roles at Distributed Spectrum
- Senior Software Engineer, Platform Engineering2w agoNew York City · Engineering
- Senior Software Engineer, Data Engineering2w agoNew York City · Engineering
- Senior Software Engineer, UI Development2w agoNew York City · Engineering
- Engineering Manager (Embedded)2w agoNew York City · Engineering
- Product Operations1mo agoNew York City · Product