← All roles

Inference Software Engineer

Etched· Architecture
Apply on company site
San Jose$175k - $400kFull-timePosted 3mo ago

About the role

Inference-focused software engineer role at Etched, responsible for porting models to Etched architecture, enhancing runtime, and optimizing communication and performance for multi-node, low-latency inference workloads.

Responsibilities

  • Support porting state-of-the-art models to our architecture. Help build programming abstractions and testing capabilities to rapidly iterate on model porting.
  • Build, enhance, and scale our runtime, including multi-node inference, intra-node execution, state management, and robust error handling.
  • Optimize routing and communication layers using our collectives.
  • Utilize performance profiling and debugging tools to identify bottlenecks and correctness issues.

Qualifications

  • Proficiency in C++ or Rust.
  • Understanding of performance-sensitive or complex distributed software systems like Linux internals, accelerator architectures (e.g. GPUs, TPUs), Compilers, or high-speed interconnects (e.g. NVLink, InfiniBand).
  • Familiarity with PyTorch or JAX.
  • Ported applications to non-standard accelerator hardware or hardware platforms.

Skills

Required:C++RustDistributed systemsAccelerator hardware experience
Nice to have:Linux internalsPyTorch or JAX

Benefits

  • Medical, dental, and vision packages with generous premium coverage
  • $500 per month credit for waiving medical benefits
  • Housing subsidy of $2.5k per month for those living within walking distance of the office
  • Relocation support for those moving to San Jose (Santana Row)
  • Various wellness benefits covering fitness, mental health, and more
  • Daily lunch + dinner in our office
  • Unlimited compute budget subject to ROI justification
Last updated Oct 15, 2026. Interested? Apply on the company site.
Etched logo

About Etched

Etched is building frontier inference clusters: co-designs chips, racks, software and manufacturing to push the pareto frontier for AI hardware.

frontier inference clustersAI hardwarechipsrackssoftwaremanufacturingparto frontier
Company profileWebsite

More open roles at Etched