← All roles

MTS, Research Engineer

Fireworks AI· Engineering
Apply on company site
Hybrid (New York, NY; San Mateo, CA)$250k - $400kFull-timePosted 3mo ago

About the role

Research Engineer focused on the intersection of model research and training infrastructure, combining open-ended research with building scalable distributed training systems.

Responsibilities

  • Conduct Open-Ended Research: Explore new model architectures, training objectives, and optimization techniques. Formulate hypotheses, design experiments, and iterate quickly based on empirical results.
  • Reproduce and Extend State-of-the-Art: Implement and reproduce results from recent machine learning papers. Identify bottlenecks, propose improvements, and scale these methods to larger datasets and models.
  • Build and Scale Training Infrastructure: Design, implement, and maintain high-performance, distributed machine learning systems. Optimize training loops, data loaders, and communication overhead across large GPU clusters.
  • Bridge Science and Engineering: Translate abstract mathematical concepts and research ideas into robust, bug-free, and efficient code.
  • Collaborate Cross-Functionally: Work closely with Research Scientists to unblock their experiments by providing tooling, optimizing code, and co-designing experiments that are hardware-aware.

Qualifications

  • Strong programming skills (Python, C++, or Rust) and a commitment to writing clean, maintainable code.
  • Deep practical knowledge of machine learning frameworks (PyTorch, JAX, or TensorFlow).
  • Experience working with large distributed systems and parallel computing (e.g., CUDA, NCCL, MPI).
  • A strong foundation in linear algebra, calculus, probability, and statistics.
  • A proven track record of implementing complex deep learning algorithms from scratch.

Skills

Required:ProgrammingML FrameworksDistributed SystemsMathematical FoundationsDeep Learning Algorithms

Benefits

  • Total compensation for this role includes meaningful equity in a fast-growing startup, along with a competitive salary and comprehensive benefits package.
Last updated Jul 29, 2026. Interested? Apply on the company site.
Fireworks AI logo

About Fireworks AI

Fastest Inference for Generative AI

Use state-of-the-art, open-source LLMs and image models at blazing fast speed, or fine-tune and deploy your own at no additional cost with Fireworks AI!

Generative AIImageLLMMultimediaSearchai-infrastructure-and-developmentliquid-ai-recruiting-targetllm

More open roles at Fireworks AI