Technical Program Manager
Palo Alto, CA$160k - $300kPosted 5mo ago
About the role
Technical Program Manager at RadixArk driving execution of large-scale, cross-functional programs across inference and training infrastructure, coordinating with kernel teams, distributed systems engineers, and external partners to deliver infrastructure supporting billions of tokens daily and 10,000+ GPU training runs.
Responsibilities
- Drive end-to-end execution of large-scale, cross-functional programs spanning inference engines (e.g., SGLang), training frameworks (e.g., Miles), and hardware integration efforts.
- Define program structure, including milestones, dependencies, critical paths, risks, and success criteria. Maintain a clear source of truth for status across all stakeholders.
- Run design reviews, sprint planning, release readiness reviews, and post-mortems. Ensure decisions are documented and follow-ups are closed out.
- Identify and unblock cross-team dependencies across kernel, runtime, scheduler, networking, and model teams before they become release blockers.
- Drive release management for major versions, including changelog ownership, compatibility validation, partner rollout sequencing, and rollback planning.
- Partner with Product Management to translate roadmap priorities into executable program plans, with clear scope, staffing, and timelines.
- Work shoulder-to-shoulder with engineering leads on technical trade-off decisions; understand the architecture deeply enough to ask the right questions and surface hidden risks.
- Coordinate hardware enablement programs with partners like Nvidia, Google, and AWS, including new accelerator bring-up, kernel co-development, and benchmark validation.
- Manage integration programs with frontier AI labs and early adopters, ensuring technical requirements, SLAs, and feedback loops are well-defined.
- Build and improve the engineering operating cadence, including standups, planning rituals, OKR tracking, dashboards, and reporting to leadership.
- Establish metrics and instrumentation for program health such as velocity, defect rates, benchmark regressions, and customer-reported issues, and drive accountability against them.
- Lead incident response coordination for production issues affecting partners; own root-cause review and corrective-action tracking.
- Improve developer productivity by identifying and removing systemic friction in our build, test, and release pipelines.
- Serve as the connective tissue between engineering, product, GTM, and external partners, ensuring everyone has the right information at the right altitude.
- Produce clear, concise written updates for leadership and partners. Translate engineering progress into business-relevant signals.
- Represent program status honestly, including risks and slips, with concrete mitigation plans.
Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.
- 4+ years of direct experience in Technical Program Management, Engineering Management, or a senior engineering role with significant program ownership, in a software or infrastructure company.
- Strong technical fluency in systems software, distributed systems, or AI/ML infrastructure; able to read code, follow architecture discussions, and challenge technical assumptions productively.
- Demonstrated track record shipping complex, multi-team programs on time, including managing dependencies, risks, and scope changes.
- Excellent written and verbal communication skills; able to drive alignment across engineers, executives, and external partners.
Skills
Required:Program managementTechnical fluency in systems software
Last updated Sep 22, 2026. Interested? Apply on the company site.
About RadixArk
SHIP AI FOR ALL
RadixArk is an infrastructure-first, deep-tech company building large-scale inference and training systems for the entire AI community.
AI systemsMilesSGLangbessemer-ai-infrastructure-2026inferenceinference-inflection-pointinfrastructureopen infrastructure
More open roles at RadixArk
- Member of Technical Staff — Security4w agoHybrid (Remote / Hybrid (global)) · Member of Technical Staff
- Talent Operations2mo agoHybrid (Palo Alto, CA) · Go-to-Market and Operations
- Member of Technical Staff — Inference-Multi-Hardware2mo agoPalo Alto, CA · Member of Technical Staff
- Member of Technical Staff — Developer Technology3mo agoPalo Alto, CA · Member of Technical Staff
- Member of Technical Staff — Developer Experience3mo agoPalo Alto, CA · Member of Technical Staff