Software Engineer, River API
Palo Alto, CA$200k - $420kPosted 2mo ago
About the role
Engineering role focused on building high-performance, scalable infrastructure for training and inference at River AI, including custom GPU kernels, distributed systems, and cluster management to enable researchers to focus on science.
Responsibilities
- Architect and deploy fault-tolerant distributed systems for training and inference workloads across clusters with thousands of nodes.
- Design high-performance kernels to maximize tensor operation efficiency, memory throughput, and networking over InfiniBand/RDMA.
- Profile systems end-to-end to resolve blockers across hardware, software, data loading pipelines, and collective communication primitives.
- Partner directly with research scientists to rapidly implement, optimize, and scale experimental model architectures.
Qualifications
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical industry experience.
- Deep expertise in systems-level languages (C, C++, or Rust) with a track record of writing performant, maintainable code.
- Strong foundation in computer architecture, memory management, and concurrent programming.
- Exceptional debugging skills, especially when tackling complex, non-deterministic issues in distributed environments.
- A highly collaborative mindset and a bias for action to push boundaries across the stack.
Skills
Required:systems-level programmingcomputer architecturedistributed systemscollaboration with researchers
Nice to have:GPU/kernel development
Benefits
- Comprehensive health, dental, and vision insurance; unlimited PTO; relocation assistance as needed.
Last updated Sep 23, 2026. Interested? Apply on the company site.
About River AI
Intelligence that flows with you
River is building a new stack for Personal AI.
LoRA fine-tuningReinforcement learningOpen modelsPay per tokenAPIPersonal AI
More open roles at River AI
- IT Lead2w agoPalo Alto, CA · Staff
- Design Verification Emulation, Hardware3w agoHybrid (Austin, TX or Palo Alto, CA) · Personal AI Hardware
- People Lead4w agoPalo Alto, CA · Staff
- Operations Lead4w agoPalo Alto, CA · Staff
- Software Engineer, GPU Kernels1mo agoPalo Alto, CA · River API