Senior ML Solutions Architect - Token Factory
Hybrid (Tel Aviv, Israel)full-timePosted 1w ago
About the role
Senior ML Solutions Architect to support Nebius Token Factory's serverless inference and fine-tuning platforms for open-source LLMs across multiple modalities, collaborating with clients to design optimized inference workflows and architect scalable AI applications.
Responsibilities
- Optimize LLM inference across various modalities to drive business value and support customer goals
- Provide support in supervised and reinforcement learning fine-tuning to maximize model quality for the customers
- Design and implement LLM-based solutions using Nebius Token Factory’s inference services
- Build production-ready applications leveraging our serverless LLM APIs, including multimodal models (text, vision, audio) and domain-specific models
- Provide technical expertise in prompt engineering, RAG architectures and model selection
- Collaborate with product and engineering teams to surface customer feedback and shape the platform roadmap
- Guide customers in scaling from POC to production with a focus on performance, reliability, and cost efficiency
Qualifications
- 5+ years of experience in ML/AI systems, with at least 2 years focused on LLMs and generative AI
- Deep knowledge of the LLM ecosystem, including model architectures and fine-tuning approaches
- Hands-on experience with Running LLMs in production: deploying and operating inference workloads
- LLM fine-tuning, including supervised fine-tuning (SFT/LoRA) and data preparation/curation; experience with RL-based fine-tuning is a strong plus
- LLM evaluation: building task-specific benchmarks and offline/online eval pipelines, including LLM-as-a-judge setups
- Inference frameworks and libraries (e.g., vLLM, SGLang, TensorRT-LLM, Transformers)
- Deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models
- Strong Python programming skills
- Excellent communication skills, with the ability to clearly explain technical concepts to diverse audiences
Skills
Required:LLM inference optimizationLLM fine-tuning (SFT/LoRA)LLM evaluationInference frameworksPython
Nice to have:RL-based fine-tuning
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Last updated Oct 14, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure