Senior Developer Advocate
Hybrid (San Francisco Bay Area)$179.5k - $224.3kfull-timePosted 6mo ago
About the role
Senior Developer Advocate based in the San Francisco Bay Area (or willing to relocate) to help developers run open models in production on Nebius' Token Factory inference platform. The role combines hands-on technical work with public-facing content, demos, and community engagement to explain production inference stacks, tradeoffs, and best practices.
Responsibilities
- Help developers and teams discover, evaluate and adopt Token Factory for production inference workloads, from a first API call on a serverless endpoint to dedicated endpoints and fine-tuned models.
- Build demos, benchmarks and reference architectures that illustrate tradeoffs (model selection, latency vs cost per token, context growth effects on multi-turn agents, reliability, and when fine-tuning or a custom speculator pays off).
- Show how Token Factory fits into existing developer stacks (OpenAI-compatible SDKs, agent frameworks, MCP and tool use, evals, embeddings and retrieval, post-training).
- Be embedded with Token Factory product and engineering: join standups, test new models/features, ensure samples and docs exist on day zero of releases.
- Own the developer feedback loop: gather issues, provide concrete product input, and follow through until it ships or is declined.
- Represent Nebius in Bay Area inference/open-model community events and open-source communities (e.g., vLLM, SGLang, Ray).
- Publish technical content and give talks guiding developers from discovery to production on Token Factory; collaborate with marketing on case studies.
- Work with the DevRel and product marketing teams on launches, community programs and content strategy.
Qualifications
- - Hands-on experience running open models in production or at scale through an inference provider or serving stack, with a clear POV on choices and tradeoffs.
- - Working understanding of serving engine internals (e.g., vLLM, SGLang): continuous batching, KV/prefix caching, quantization, speculative decoding and their impact on latency/cost.
- - Current knowledge of open model ecosystem, including model recommendations for workloads.
- - Comfort writing/reviewing code, reproducing issues, and shipping fixes to docs/samples.
- - Track record of building and explaining in public ( talks, open-source, writing, or active technical presence ). DevRel title not required.
- - Ability to explain complex systems clearly to technical and non-technical audiences; credible technical partner to engineers, PMs and customers.
- - Based in the San Francisco Bay Area, or willing to relocate.
Skills
Required:Open-model production deploymentServing engine internalsPublic technical communication
Benefits
- - Health insurance: 100% company-paid medical, dental, and vision for employees and families.
- - 401(k) plan with up to 4% company match and immediate vesting.
- - Parental leave: 20 weeks paid for primary caregivers, 12 weeks for secondary caregivers.
- - Remote work reimbursement: up to $85/month for mobile and internet.
- - Disability & life insurance: company-paid coverage for short-term, long-term and life insurance.
Last updated Sep 23, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization4d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC4d agoRemote · Network Infrastructure
- Transportation Logistics Specialist4d agoHybrid (Europe) · Infrastructure