Staff Software Engineer (AI)
New York, NY$300k - $325kfull-timePosted 5mo ago
About the role
Staff Software Engineer (AI) to design and build production-grade AI systems (RAG pipelines, agentic workflows, LLM-powered features) for Pendo's PX platform, partnering with product, design, and engineering to ship AI-native experiences at scale from New York office.
Responsibilities
- Applied AI systems: Design and build AI-native systems, including RAG pipelines, agentic workflows, and LLM-powered product features.
- Model strategy: Make principled decisions about when to prompt, when to fine-tune, and when to use a different technical approach entirely; communicate tradeoffs clearly.
- Evaluation and guardrails: Instrument and evaluate model outputs with evaluation frameworks and guardrails for real-world usage.
- Productionize AI ownership: Own model deployment, monitoring, latency optimization, cost management, and reliability at scale; ensure observability and production readiness.
- Full-stack delivery: Contribute across the stack to ship complete AI products in front of users.
- Product partnership: Collaborate with product and design to frame problems and keep the team focused on impactful work.
- Technical leadership: Stay current on research and tooling; bring advances back to the team and raise technical bar.
Qualifications
- Deep hands-on experience building and shipping LLM-powered systems, including retrieval-augmented generation, tool use, and agent orchestration frameworks.
- Ability to set technical direction for AI systems across teams, establish architectural patterns, and make foundational model strategy decisions.
- Experience owning outcomes across team boundaries, driving alignment with product and broader organization approaches to AI.
- Strong command of model evaluation, including designing evaluation suites, reasoning about bias-variance, and mitigating hallucinations.
- Solid understanding of modern model architectures (transformers, diffusion models) and when/how to apply them.
- Production experience: model deployment, monitoring pipelines, latency, cost, and reliability optimization in live environments.
- Strong full-stack fundamentals and ability to ship complete, user-facing AI products across backend and frontend.
- Exceptional communication skills to explain complex technical decisions to engineers, PMs, and executives.
- Demonstrated product judgment about what should be built before how to build it.
Skills
Required:LLM-powered systemsTechnical leadershipModel evaluationFull-stack delivery
Benefits
- Highly competitive, employer-heavy coverage, including $0 premium options
- Strong 401(k) match, equity, and flexible time off.
Last updated Oct 7, 2026. Interested? Apply on the company site.
About Pendo
Product Experience & Analytics Platform | Pendo
AI-powered platform that improves how everyone uses software. Product analytics, in-app guides, churn prediction, and agent performance—unified by Pendo AI.
product analyticscustomer successuser onboardingin-app guidessession replayNPSfeedbackdigital adoption
More open roles at Pendo
- Account Director Enterprise Sales4d agoMunich, Germany · Enterprise
- Sr. Account Executive Enterprise Sales4d agoMunich · Enterprise
- Security Enablement Engineer4d agoHybrid (Raleigh, NC) · Information Security
- Software Engineer, Mobile SDK4d agoHerzliya, Israel · Engineering
- Sr. Customer Engineer1w agoHybrid (London, UK) · Customer Engineering