← All roles

Member of Technical Staff, AI Training Infrastructure

Fireworks AI· Engineering
Apply on company site
San Mateo, CA$175k - $220kfull-timePosted 11mo ago

About the role

Training Infrastructure Engineer responsible for designing, building, and optimizing large-scale AI training infrastructure, collaborating with researchers to create robust training pipelines, optimize distributed workloads, and ensure reliable model development.

Responsibilities

  • Design and implement scalable infrastructure for large-scale model training workloads
  • Develop and maintain distributed training pipelines for LLMs and multimodal models
  • Optimize training performance across multiple GPUs, nodes, and data centers
  • Implement monitoring, logging, and debugging tools for training operations
  • Architect and maintain data storage solutions for large-scale training datasets
  • Automate infrastructure provisioning, scaling, and orchestration for model training
  • Collaborate with researchers to implement and optimize training methodologies
  • Analyze and improve efficiency, scalability, and cost-effectiveness of training systems
  • Troubleshoot complex performance issues in distributed training environments

Qualifications

  • Bachelor's degree in Computer Science, Computer Engineering, or related field, or equivalent practical experience
  • 3+ years of experience with distributed systems and ML infrastructure
  • Experience with PyTorch
  • Proficiency in cloud platforms (AWS, GCP, Azure)
  • Experience with containerization, orchestration (Kubernetes, Docker)
  • Knowledge of distributed training techniques (data parallelism, model parallelism, FSDP)

Skills

Required:Distributed systemsPyTorchCloud platformsContainerization and orchestrationDistributed training techniques

Benefits

  • Total compensation includes equity in a fast-growing startup, competitive salary, and comprehensive benefits package
  • Base Pay Range (Plus Equity): $175,000—$220,000 USD
Last updated Jul 29, 2026. Interested? Apply on the company site.
Fireworks AI logo

About Fireworks AI

Fastest Inference for Generative AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed, or fine-tune and deploy your own at no additional cost with Fireworks AI!

Generative AIImageLLMMultimediaSearchai-infrastructure-and-developmentliquid-ai-recruiting-targetllm
Company profileWebsite

More open roles at Fireworks AI