Machine Learning Performance Engineer
Jane Street· Trading, Research, and Machine Learning
Londonfull-timePosted 3mo ago
About the role
Engineer with experience in low-level systems programming and optimisation to join Jane Street's ML team. Focus on optimizing performance of models (training and inference) in a high-scale, low-latency, real-time environment, with a whole-systems approach including storage, networking, and GPU-CPU interactions.
Responsibilities
- Optimise the performance of ML models for training and inference.
- Improve throughput and latency for real-time systems and high-throughput research inference.
- Address whole-systems performance including storage, networking, host- and GPU-level considerations.
- Evaluate whether throughput translates to goodput and analyze vector loads from memory hierarchy.
- Debug and optimize end-to-end training performance and real-time inference in a distributed GPU setting.
Qualifications
- Understanding of modern ML techniques and toolsets
- Systems knowledge to debug a training run’s performance end to end
- Low-level GPU knowledge (PTX, SASS, warps, cooperative groups, Tensor Cores, memory hierarchy)
- Debugging and optimization using CUDA tools (CUDA GDB, NSight Systems, NSight Compute)
- Library knowledge (Triton, CUTLASS, CUB, Thrust, cuDNN, cuBLAS)
- Intuition about CUDA graph launches, tensor cores, warp synchronization, asynchronous memory
- Background in networking with Infiniband, RoCE, GPUDirect, NVLink and related technologies
- Understanding of distributed GPU training algorithms (NCCL, MPI)
- Willingness to question approaches and tools; fluent in English
Skills
Required:Modern ML techniques and toolsetsEnd-to-end performance debugging for ML trainingLow-level GPU knowledgeCUDA debugging/profiling toolsGPU ML librariesCUDA performance conceptsNetworking for GPU clustersDistributed GPU training algorithmsSoft skills
Last updated Oct 25, 2026. Interested? Apply on the company site.
About Jane Street
SIX
Jane Street is a quantitative trading firm and liquidity provider with a unique focus on technology and collaborative problem solving.
Machine learningquantitative tradingtechnologyresearch-drivenglobal marketsinternshipseventsprograms
More open roles at Jane Street
- Travel SpecialisttodayNew York · Hospitality and Building Operations
- Product Manager, Creative EngagementtodayNew York · Creative
- MacOS EngineertodayHong Kong · Technology
- AV EngineertodayHybrid (Hong Kong) · Technology
- Compliance AnalysttodayHybrid (London) · Legal and Compliance