← All roles

Senior Software Engineer - Together Cloud Platform

Together AI· Engineering
Apply on company site
Hybrid (San Francisco, CA)$160k - $230kfull-timePosted 11mo ago

About the role

Senior Backend Engineer responsible for building the next generation AI cloud platform, including a distributed GPU scheduling system, global management plane, and customer-facing cloud services for Together AI's AI Acceleration Cloud.

Responsibilities

  • Identify, design, and develop foundational backend services that power Together’s cloud platform
  • Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
  • Partner with product teams to understand functional requirements and deliver solutions that meet business needs
  • Write clear, well-tested, and maintainable software and IaC for both new and existing systems
  • Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance
  • Participate in an on-call rotation to address critical incidents when necessary

Qualifications

  • 5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
  • Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
  • Excellent communication skills – able to write clear design docs and work effectively with both technical and non-technical team members
  • Demonstrated experience with building and operating high-performance and/or globally distributed microservice architectures across one or more cloud providers (AWS, Azure, GCP)
  • Strong systems knowledge across compute, networking, and storage, including concurrency, memory management, performant I/O, and scale
  • Experience developing against and managing a relational database, such as PostgreSQL
  • Expert-level programmer in one or more of programming language (Golang preferred)
  • Proficiency in version control practices and integrating IaC with CI/CD pipelines
  • Experience with Kubernetes and containers preferred
  • Experience building and operating data infrastructure (Kinesis, Airflow, Kafka, etc) a plus
  • Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience

Skills

Required:Distributed systems designCloud architecture (multi-cloud)PostgreSQLGolangIaC + CI/CD
Nice to have:KubernetesData infrastructure

Benefits

  • startup equity
  • health insurance
  • remote work flexibility
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Together AI

The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training

Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.

AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
Company profileWebsite

More open roles at Together AI