System Engineer (Token Factory)
Hybrid (Austin, TX / Remote - Europe)full-timePosted 7mo ago
About the role
Token Factory is part of Nebius Cloud, building an inference platform for fast, reliable deployment of foundation models at scale. The role focuses on low-level AI inference kernels, GPU performance, and hardware integration.
Responsibilities
- Develop and optimize low-level kernels and runtime components for AI inference
- Improve performance of inference engines GPU platforms
- Profile and debug system-level and hardware-level performance issues
- Integrate support for new hardware architectures (Hopper, Blackwell, Rubin)
- Collaborate with ML and backend teams to optimize end-to-end execution
Qualifications
- Strong proficiency in C++, OR expertise in GPU programming with a focus on low-level high-performance coding and memory management
- Experience in GPU programming or systems-level software development, e.g. operating system internals, kernel modules, or device drivers
- Hands-on experience with profiling and debugging tools to identify performance issues on both CPUs and GPUs, and the ability to optimize code based on those findings
- Solid understanding of CPU/GPU architecture and memory hierarchy
Skills
Required:C++ programmingGPU programmingProfiling and debugging toolsCPU/GPU architecture & memory hierarchy
Benefits
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
Last updated Oct 21, 2026. Interested? Apply on the company site.
About Nebius
The ultimate cloud for AI explorers
Discover the most efficient way to build, tune and run your AI models and applications on top-notch NVIDIA® GPUs.
AI CloudToken FactoryGPUKubernetesSlurmManaged servicesTerraformAPI
More open roles at Nebius
- Staff Machine Learning Engineer, LLM Inference Optimization5d agoHybrid (Remote/Hybrid across listed locations) · ML
- Staff Site Reliability engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Engineering manager - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Staff Software engineer - Network infrastructure - APAC5d agoRemote · Network Infrastructure
- Transportation Logistics Specialist5d agoHybrid (Europe) · Infrastructure