← All roles

Software Engineer - AI Developer Productivity

Baseten· EPD
Apply on company site
Hybrid (San Francisco), Hybrid (Toronto), Hybrid (New York), Hybrid (Montreal), Hybrid (Seattle)$165k - $330kFull-timePosted 2mo ago

About the role

Baseten zoekt to build an internal AI developer platform to enable engineers to adopt AI tooling with good defaults, low friction, and self-service capabilities. You will own the platform end-to-end, evaluate and integrate AI coding tools, and drive adoption through developer experience.

Responsibilities

  • Own the internal AI developer platform end to end — architecture, build, rollout, operation, measurement.
  • Evaluate and integrate third-party AI coding tools (Claude Code, Cursor, Codex, and others), and build the context layer that makes them work against our monorepo.
  • Build frameworks that let other engineers create their own agents without deep LLM expertise.
  • Establish the evaluation practice for AI-assisted development at Baseten, and use it to drive investment decisions.
  • Drive adoption through developer experience — good defaults, clear docs, low friction — not mandate.
  • Embed with teams to find where AI genuinely unblocks them, then generalize those wins into platform capabilities.
  • Own the safety layer: permissions, secrets handling, audit trails, cost management.

Qualifications

  • Have 4+ years of relevant industry experience building and enabling AI native SDLC
  • Strong proficiency in Python and/or Go, building tools other engineers depend on daily.
  • Hands-on experience with LLMs and agent frameworks — tool calling, MCP, context management, orchestration, failure handling. You've shipped something agentic that real people used, not just prototyped.
  • Deep personal fluency with AI coding tools and well-formed opinions about where they break down.
  • Platform mindset: you build for adoption and self-service, treat internal engineers as customers, and would rather ship a good default than write a style guide.
  • Developer tooling, CI/CD, and Kubernetes/Docker fundamentals.
  • Comfort with ambiguity — this space invalidates its own best practices every few months.
  • Excellent written communication. Much of your leverage is docs, templates, and examples that scale beyond conversations you're in.

Skills

Required:PythonLLMs and agent frameworksCI/CD
Nice to have:Go

Benefits

  • Competitive compensation, including meaningful equity
  • (U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
  • Flexible PTO policy including company wide Winter Break (offices closed from Christmas Eve to New Year's Day)
  • Paid parental leave
  • Fertility and family-building stipend through Carrot
  • (U.S. only) Company-facilitated 401(k)
  • Exposure to a variety of ML startups, offering learning and networking opportunities.
Last updated Oct 21, 2026. Interested? Apply on the company site.
Baseten logo

About Baseten

Inference is everything

Effortlessly serve optimized open source & custom models on the fastest, most reliable model delivery network.

AICloud InfrastructureDeveloper ToolsInference PlatformMachine LearningModel DeploymentModel Runtimesai-infrastructure-and-development
Company profileWebsite

More open roles at Baseten