← All roles

Research Intern, Frontier Speculative Decoding (Summer 2027)

Together AI· Research
Apply on company site
Hybrid (San Francisco, CA)$58/hr - $70/hrinternshipPosted 4d ago

About the role

Research internship focusing on speculative decoding to develop efficient draft models and serving-ready architectures for frontier open models. Gain hands-on experience training, fine-tuning, distilling draft models, and evaluating in realistic traffic.

Responsibilities

  • Research and prototype new efficient speculative decoding algorithms and draft model architectures
  • Train, fine-tune and distill draft models, and design rigorous experiments to validate hypotheses.
  • Implement optimized version for serving engines to show efficacy in real world workloads
  • Communicate the plans, progress, and results of projects to the broader team
  • Share findings through technical write-ups and blog posts, and help bring successful ideas into production

Qualifications

  • Currently pursuing a Master's or Ph.D. degree in Computer Science, Electrical Engineering, or a related field
  • Strong knowledge of Machine Learning and Deep Learning fundamentals
  • Hands-on experience training or fine-tuning large models with distributed training frameworks (e.g., Megatron-LM, FSDP)
  • Familiarity with modern model architectures, such as Mixture-of-Experts and hybrid attention

Skills

Required:Machine Learning fundamentalsDistributed trainingResearch communication
Nice to have:Speculative decoding

Benefits

  • housing stipends
  • competitive compensation and benefits including location-based hourly rates
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Together AI

The AI Acceleration Cloud - Fast Inference, Fine-Tuning & Training

Run and fine-tune generative AI models with simple APIs and scalable GPU clusters. Train & deploy at scale on The AI Acceleration Cloud.

AI native cloudFine-TuningGPU clustersInferenceTrainingai-infrastructure-and-developmentbrex-fastest-growing-2025liquid-ai-recruiting-target
Company profileWebsite

More open roles at Together AI