← All roles

Machine Learning Performance Engineer

Jane Street· Trading, Research, and Machine Learning
Apply on company site
Hybrid (New York, NY)$300kfull-timePosted 3mo ago

About the role

Engineer role focused on optimizing the performance of machine learning models in a finance trading environment, with emphasis on end-to-end training and real-time inference performance across CPU/GPU and whole-system considerations.

Responsibilities

  • Optimizing the performance of ML models for training and inference
  • Improve throughput and latency in real-time systems and high-throughput research environments
  • Work on low-level optimization including storage, networking, and host- and GPU-level considerations
  • Assess whether throughput translates to real goodput and optimize vector loading from memory hierarchies

Qualifications

  • Understanding of modern ML techniques and toolsets
  • Experience debugging ML training performance end-to-end
  • Low-level GPU knowledge (PTX, SASS, warps, Tensor Cores, memory hierarchy)
  • Debugging and optimization using CUDA GDB, NSight Systems, NSight Compute
  • Library knowledge of Triton, CUTLASS, CUB, Thrust, cuDNN, cuBLAS
  • Intuition about CUDA graph launch, tensor core arithmetic, warp synchronization, asynchronous memory loads
  • Background in Infiniband, RoCE, GPUDirect, PXN, rail optimization, NVLink
  • Understanding of distributed GPU training algorithms (NCCL or MPI)
  • Willingness to ask hard questions and explore right tools and approaches

Skills

Required:Modern ML techniques and toolsetsEnd-to-end ML training performance debuggingPTX, SASS, warps, Tensor Cores, memory hierarchyCUDA tooling (GDB, NSight Systems, NSight Compute)Triton, CUTLASS, CUB, Thrust, cuDNN, cuBLASNetworking for GPU clusters (Infiniband, RoCE, NVLink, GPUDirect)Distributed GPU training algorithms (NCCL or MPI)Curiosity and problem-solving mindset
Nice to have:CUDA graph launch and warp-level optimization

Benefits

  • Base salary $300,000 plus annual discretionary bonus
  • Equal Opportunity Employer
Last updated Oct 25, 2026. Interested? Apply on the company site.

About Jane Street

SIX

Jane Street is a quantitative trading firm and liquidity provider with a unique focus on technology and collaborative problem solving.

Machine learningquantitative tradingtechnologyresearch-drivenglobal marketsinternshipseventsprograms
Company profileWebsite

More open roles at Jane Street