Senior Customer AI Engineer - Token Factory
Hybrid (United States)$209.8k - $262.2kFull-timePosted 1w ago
About the role
Senior Customer AI Engineer for Nebius Token Factory, focusing on transitioning customers from PoC to production, ensuring scalable, performant, and cost-efficient AI deployments on Nebius infrastructure. Remote role from the United States.
Responsibilities
- Lead the transition from PoC to production
- Ensure customer workloads are deployed, stable, and scalable
- Drive time-to-production and time-to-value
- Understand customer architectures and use cases
- Monitor and improve: performance (latency, throughput), cost efficiency, reliability
- Identify and resolve bottlenecks proactively
- Work directly with customer engineering teams
- Provide guidance on best practices and optimisation
- Translate technical challenges into actionable solutions
- Act as a primary technical contact for production issues
- Coordinate with internal teams to resolve incidents
- Communicate clearly during high-pressure situations
- Identify opportunities to optimise and expand usage
- Provide structured feedback to Product and Infrastructure teams
- Help shape better solutions based on real customer needs
Qualifications
- Practical knowledge of inference frameworks (e.g. vLLM, TensorRT, or similar)
- Solid understanding of cloud or infrastructure systems
- Distributed systems or high-load applications
- AI/ML workloads (LLMs, inference, etc.) is a strong plus
- Ability to troubleshoot and reason about system performance
- Experience working directly with technical customers (e.g. engineers, ML teams)
- Ability to communicate complex topics clearly and effectively
- Strong sense of ownership – you drive outcomes, not just tasks
- Ability to manage multiple customers and priorities
- Structured, proactive, and solution-oriented mindset
Skills
Required:Inference frameworksCloud / infrastructure systemsDistributed systems / high-load applicationsCustomer-facing communication
Nice to have:AI/ML workloads (LLMs, inference)
Benefits
- Health insurance: 100% company-paid medical, dental, and vision coverage for employees and families
- 401(k) plan with up to 4% company match with immediate vesting
- Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers
- Remote work reimbursement up to $85/month for mobile and internet
- Disability & life insurance: company-paid short-term, long-term and life insurance coverage
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure