← All roles

Member of Technical Staff, Cloud Infrastructure

Fireworks AI· Engineering
Apply on company site
Hybrid (New York, NY; San Mateo, CA)$175k - $220kfull-timePosted 11mo ago

About the role

Software Engineer on the Cloud Infrastructure team building foundational systems for Fireworks AI, including scalable backend infrastructure, multi-cloud support, and end-to-end reliability for distributed ML workloads.

Responsibilities

  • Architect and build scalable, resilient, and high-performance backend infrastructure to support distributed training, inference, and data processing pipelines.
  • Lead technical design discussions, mentor other engineers, and establish best practices for building and operating large-scale ML infrastructure.
  • Design and implement core backend services (e.g., job schedulers, resource managers, autoscalers, model serving layers) with a focus on efficiency and low latency.
  • Drive infrastructure optimization initiatives, including compute cost reduction, storage lifecycle management, and network performance tuning.
  • Collaborate cross-functionally with ML, DevOps, and product teams to translate research and product needs into robust infrastructure solutions.
  • Continuously evaluate and integrate cloud-native and open-source technologies (e.g., Kubernetes, Kubeflow, MLFlow) to enhance our platform’s capabilities and reliability.
  • Own end-to-end systems from design to deployment and observability, with a strong emphasis on reliability, fault tolerance, and operational excellence.
  • Ensuring System Reliability: design for high availability, scalability, fault tolerance, disaster recovery, and performance optimization across multi-cloud infrastructure.
  • Observability & Monitoring: develop and maintain monitoring, alerting, logging, and tracing solutions for deep insights into system health and performance.

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
  • 5+ years of experience designing and building backend infrastructure in cloud environments (e.g., AWS, GCP, Azure).
  • Proven experience in ML infrastructure and tooling (e.g., PyTorch, TensorFlow, Vertex AI, SageMaker, Kubernetes, etc.).
  • Strong software development skills in languages like Python, or C++.
  • Deep understanding of distributed systems fundamentals: scheduling, orchestration, storage, networking, and compute optimization.

Skills

Required:Backend infrastructure designDistributed systemsCloud platformsML infrastructure tooling

Benefits

  • Total compensation includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package.
Last updated Jul 29, 2026. Interested? Apply on the company site.
Fireworks AI logo

About Fireworks AI

Fastest Inference for Generative AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed, or fine-tune and deploy your own at no additional cost with Fireworks AI!

Generative AIImageLLMMultimediaSearchai-infrastructure-and-developmentliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at Fireworks AI