← All roles

Senior Software Engineer, Observability

Together AI· Engineering
Apply on company site
Hybrid (San Francisco, CA)$200k - $280kfull-timePosted 11mo ago

About the role

Senior role on Together AI's AI Infrastructure team focusing on scalable observability platforms, monitoring, and incident response for a distributed AI platform.

Responsibilities

  • Design and implement a scalable observability platform (metrics, logs, traces) using tools like Prometheus, Grafana, ClickHouse, ClickStack, and OpenTelemetry, including telemetry data pipelines and log aggregation workflows.
  • Develop automated monitoring, alerting, and anomaly detection systems, including SLIs/SLOs, runbooks, and predictive analytics for critical services.
  • Build and deploy custom observability tools and infrastructure-as-code using Go, Python, Terraform, Ansible, and Helm.
  • Collaborate with engineering teams to enhance distributed tracing and application monitoring, and lead incident response with post-mortem analysis.
  • Define observability best practices.

Qualifications

  • Expertise in observability platforms (Prometheus, Grafana, ClickStack, OpenTelemetry) and cloud-native monitoring services (AWS, GCP, Azure).
  • Strong programming skills in Go, Python, or similar languages, with proficiency in infrastructure-as-code tools (Terraform, Ansible, Helm).
  • Experience designing, operating, and scaling large-scale distributed systems and pipelines for high-volume data ingestion and real-time querying.
  • Deep understanding of containerization (Docker) and orchestration (Kubernetes).
  • Knowledge of microservices architecture, service mesh technologies, CI/CD pipelines, and GitOps workflows.
  • Expertise in managing databases (PostgreSQL, MongoDB, Redis) and time-series databases with high-cardinality data.

Skills

Required:Observability toolingProgrammingInfrastructure as codeDistributed systemsContainerization and orchestrationDatabases

Benefits

  • health insurance
  • remote work flexibility
  • equity (startup equity)
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Together AI

The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training

Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.

AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
Company profileWebsite

More open roles at Together AI