← All roles

Research Intern, Frontier Speculative Decoding (Winter 2027)

Together AI· Research
Apply on company site
Hybrid (San Francisco)$58/hr - $70/hrinternshipPosted 4d ago

About the role

Research internship focused on speculative decoding for frontier open models, including developing draft model architectures, training and distillation, and evaluating in realistic serving workloads.

Responsibilities

  • Research and prototype new efficient speculative decoding algorithms and draft model architectures
  • Train, fine-tune and distill draft models, and design rigorous experiments to validate hypotheses
  • Implement optimized version for serving engines to show efficacy in real world workloads
  • Communicate the plans, progress, and results of projects to the broader team
  • Share findings through technical write-ups and blog posts, and help bring successful ideas into production

Qualifications

  • Currently pursuing a Master's or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
  • Strong knowledge of Machine Learning and Deep Learning fundamentals
  • Hands-on experience training or fine-tuning large models with distributed training frameworks (e.g., Megatron-LM, FSDP)
  • Familiarity with modern model architectures, such as Mixture-of-Experts and hybrid attention

Skills

Required:Machine Learning fundamentalsDistributed model training
Nice to have:Speculative decoding

Benefits

  • housing stipends
  • competitive compensation and benefits
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Together AI

The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training

Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.

AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
Company profileWebsite

More open roles at Together AI