Senior AI Engineer
Pulley· Engineering
San Francisco$230k - $280kFull-timePosted 11mo ago
About the role
Senior AI Engineer role focused on building the intelligence behind Pulley’s AI-powered permitting platform, turning unstructured inputs into structured outputs, developing evaluation/observability, and shipping agent-driven AI features in production.
Responsibilities
- Own AI-powered features end-to-end—from talking to users and defining what “correct” means for a permitting workflow, through prompt and pipeline design, evals, deployment, and iteration in production
- Turn unstructured permitting documents, city regulations, and jurisdiction workflows into structured, reliable outputs—extraction, classification, retrieval, and agentic workflows over documents that were never designed to be machine-readable
- Build the evaluation and observability foundation that lets us ship LLM-powered features with confidence: define ground truth, measure quality and regressions, and know when a model change is actually an improvement
- Build with AI agents as a daily practice—directing, reviewing, and shipping agent-driven work at high velocity while owning the quality bar
- Make technical and product decisions that have direct impact on our customers and their projects
- Raise the bar for the engineers around you in how they build with LLMs, through design review, mentorship, and the standards you set in your own work
Qualifications
- 4+ years of software engineering experience, with a substantial portion building production LLM or ML systems
- Track record of owning an LLM-powered product surface end-to-end: requirements through production, including the unglamorous parts—data quality, eval design, cost and latency, failure handling
- Deep hands-on experience with large language models in production—prompting, retrieval-augmented generation, structured extraction, tool use and agentic workflows, and knowing when each is the wrong tool
- Experience designing evals and otherwise making LLM-powered features reliable in production
- Real experience building with AI coding agents—not just autocomplete; you’ve shipped work where agents did substantial implementation under your direction
- Ability to architect durable systems while making pragmatic tradeoffs
- Based in the San Francisco Bay Area and willing to work in person 4 days a week
Skills
Required:AI/ML systems engineeringPrompting and retrieval-augmented generationEvaluation design and observabilityAI agents and agentic workflowsSystem architecture
Last updated Sep 24, 2026. Interested? Apply on the company site.
About Pulley
Fast Permitting, Made Simple
Pulley - Construction Permitting Platform
Construction Permitting
More open roles at Pulley
- AI Operations Engineer2w agoHybrid (San Francisco) · Engineering
- Staff AI Engineer4w agoSan Francisco · Engineering
- Project Manager, Permitting [San Francisco]1mo agoRemote · Permit Operations
- Head of Business Development and Partnerships2mo agoHybrid (New York) · Sales
- Enterprise Account Executive2mo agoHybrid (New York) · Sales