Principal ML Solutions Architect - Token Factory
Hybrid (United States)$208k - $261kfull-timePosted 1w ago
About the role
Senior technical authority for Token Factory's serverless inference and fine-tuning platform. Owns architecture, performance, and roadmap for large strategic accounts; mentors Architects; shapes platform direction with backend, product, and research teams.
Responsibilities
- Own the most complex, highest-stakes customer engagements from architecture through production across multiple modalities, driving measurable business value
- Optimize LLM inference at the framework and hardware level and codify the resulting best practices into reusable playbooks for the team
- Lead supervised and reinforcement fine-tuning efforts to maximize model quality
- Design and implement production-ready LLM solutions using Token Factory's inference services
- Provide deep technical expertise in prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale
- Partner closely with product, engineering and research to surface customer needs, prototype platform features, and directly influence the roadmap
- Guide customers from PoC to production with a focus on performance, reliability, and cost efficiency — and define the standards by which the team does so
- Mentor Senior and mid-level Solutions Architects; raise the technical bar of the team through review, enablement, and knowledge sharing
- Represent Token Factory externally through talks, blog posts, and conferences
Qualifications
- 8+ years of experience in ML/AI systems, with at least 4 years focused on LLMs and generative AI
- Demonstrated technical leadership: owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers
- Expert knowledge of the LLM ecosystem: model architectures, fine-tuning approaches, and inference internals
- Deep, hands-on command of inference optimization: quantization, KV-cache management, batching, routing, etc.
- Running LLMs in production at scale: deploying, operating, and debugging inference workloads down to the framework level
- LLM fine-tuning, including SFT/LoRA and data preparation/curation; experience with RL-based fine-tuning
- LLM evaluation: building task-specific benchmarks and offline/online eval pipelines, including LLM-as-a-judge setups
- Inference frameworks and libraries (vLLM, SGLang, TensorRT-LLM) with ability to read/modify internals
- Deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models
- Strong Python programming skills
- Excellent communication skills
Skills
Required:ML/AI systems leadershipLLM ecosystem expertiseInference optimization
Benefits
- Health Insurance: 100% company-paid medical, dental, and vision coverage for employees and families
- 401(k) Plan: Up to 4% company match with immediate vesting
- Parental Leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
- Remote Work Reimbursement: Up to $85/month for mobile and internet
- Disability & Life Insurance: Company-paid short-term, long-term, and life insurance coverage
Last updated Oct 14, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure