← All roles

Research Engineer, Large-Scale Training

Together AI· Research
Apply on company site
San Francisco$200k - $290kfull-timePosted 2mo ago

About the role

Research Engineer on the Scaling Team within Model Shaping, focused on turning cutting-edge research in efficient foundation model training into robust, high-performance systems. Responsibilities include profiling and optimizing training infrastructure, integrating new model architectures, running experiments, and enabling support for open-source foundation models on the Together AI platform.

Responsibilities

  • Design, implement, and optimize core components of Together's large-scale training infrastructure.
  • Integrate new model architectures, validate training correctness and convergence, and optimize performance for production fine-tuning workloads.
  • Profile distributed training workloads to identify and eliminate bottlenecks across compute, memory, and communication.
  • Design and execute experiments to validate performance hypotheses and benchmark new approaches against state-of-the-art methods.
  • Partner closely with Research Scientists to productionize novel training methods and contribute to publications and open-source releases.
  • Rapidly enable support for newly released open-source foundation models on the Together platform.
  • Build and maintain experimental infrastructure that accelerates research while ensuring production-quality reliability and scalability.

Qualifications

  • Demonstrated ability to independently take ambiguous performance or infrastructure problems from investigation through deployment.
  • Strong programming skills in Python and PyTorch, with an emphasis on writing efficient, maintainable code.
  • Hands-on experience training or fine-tuning large neural networks in multi-GPU or multi-node environments.
  • Solid understanding of ML systems fundamentals, including GPU architecture, mixed-precision training, and distributed training paradigms such as data, tensor, pipeline, or expert parallelism.
  • Strong communication skills and the ability to collaborate effectively with both researchers and engineers.
  • Passion for staying current with advances in AI research and applying them to real-world systems.
  • Excitement about translating cutting-edge research into production systems that deliver customer impact.

Skills

Required:PythonPyTorchMulti-GPU / Multi-node trainingML systemsExperiment design

Benefits

  • competitive compensation
  • startup equity
  • health insurance
  • other benefits
Last updated Sep 9, 2026. Interested? Apply on the company site.

About Together AI

The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training

Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.

AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
Company profileWebsite

More open roles at Together AI