ML Researcher, Foundational Models
BengaluruFull-timePosted 3mo ago
About the role
Researcher focused on open-ended questions to shape next-generation foundational models. Not a fine-tuning role; emphasizes architecture, optimization, data composition, training dynamics, ablations, and production-ready decisions with access to large-scale compute and close collaboration with training stack and data pipelines.
Responsibilities
- Drive open-ended research on architecture, optimization, scaling behaviour, training stability, and post-training recipes for our next generation of foundational models.
- Design and execute ablations at scales that actually inform large-run decisions — including running pre-training experiments end-to-end yourself.
- Translate research findings into concrete proposals for the next training run, and own those proposals through to production.
- Work shoulder-to-shoulder with the infrastructure and data teams; many of the most important research questions live at that boundary.
- Read broadly, write internally, and publish externally when the work merits it.
Qualifications
- PhD in Machine Learning, Computer Science, or a closely related field (or in the final stages of completion).
- 3+ years of research experience post-PhD (or equivalent depth). Exceptional early-career candidates with a strong research record will be considered.
- First-author publications at top-tier ML venues such as NeurIPS, ICML, ICLR, ACL, EMNLP, or COLM.
- Hands-on experience pre-training transformer-based language models from scratch, ideally at 7B+ parameters.
- Meaningful contributions to the open-source LLM ecosystem — research code, model releases, datasets, or substantive contributions to widely-used projects.
- Fluency in PyTorch and comfort with distributed training.
- Strong intuition for experimental design — knowing what to measure, what to ablate, and what scale a result needs to hold at before it can be trusted.
Skills
Required:PhD or equivalent in ML/CS
Benefits
- Not specified in the description.
Last updated Jul 14, 2026. Interested? Apply on the company site.
About Sarvam
Sarvam | India's Full-Stack Sovereign AI Platform
Sarvam is India's full-stack sovereign AI platform, with speech-to-text, text-to-speech, translation, and conversational agents across 22 Indian languages. Start free.
API PricingAbout UsAksharAryaCareersConversationsDocument DigitisationDocumentation
More open roles at Sarvam
- Software Engineer - Model API Platform1w agoBengaluru · Engineering
- Staff Engineer - Systems Engineering2w agoBengaluru · Engineering
- Staff Engineer - Telephony2w agoBengaluru · Engineering
- Growth Marketing Intern3w agoBengaluru · Marketing
- Marketing Intern4w agoBengaluru · Marketing