← All roles

Tools Developer (Rust / Linux)

Fractile· Developer Experience
Apply on company site
Hybrid (London)full-timePosted 1w ago

About the role

Developer Experience role within Fractile's Software organisation, focusing on building tooling and workflows to help engineers optimize inference hardware usage and performance for their AI accelerator.

Responsibilities

  • Identify tooling opportunities and design new tools to fit into an LLM engineer's workflow with minimal disruption
  • Deliver tooling that is functional and easy to learn and use
  • Collaborate with multiple teams and stakeholders to improve inference performance and user experience
  • Contribute to the development of the software stack for AI inference systems (ML compilers, device drivers, systems firmware, runtime, libraries, tooling, simulators, and deployment solutions)
  • Understand current state of development for inference hardware and identify opportunities for performance improvements

Qualifications

  • Experience with inference frameworks such as JAX and/or PyTorch
  • Experience of software development in Python, Rust, C/C++, or similar language
  • Experience monitoring and optimising code written in CUDA, ROCm, OpenCL, or similar
  • Experience monitoring and optimising LLM deployments with 50+ billion parameters
  • Experience working with stakeholders across multiple teams
  • Self-driven with ability to design and deliver tooling for LLM engineers’ workflows
  • Background as FDE or in a company providing inference services using their own models (preferred)

Skills

Required:Inference frameworksSystems programmingKernel/accelerator toolingLLM deployment optimization

Benefits

  • Competitive salary reflective of experience
  • Meaningful equity
  • Private Medical, Dental and Vision
  • Contributory Pension
  • 25 Days holiday plus bank holidays
  • Life/Critical Illness Insurance
  • Inclusive and diverse work environment
Last updated Oct 15, 2026. Interested? Apply on the company site.
Fractile logo

About Fractile

Radically Accelerate Frontier Model Inference

Fractile is designing AI compute systems that will enable the next generation of AI scaling: frontier model inference, 25x faster, at 1/10th the cost.

frontier model inferenceAI computecompute systemsAI scalinginference hardwareprocessor innovation
Company profileWebsite

More open roles at Fractile