← All roles

AI Context & Data Infrastructure Engineer

Town· EPD
Apply on company site
San Francisco$250k - $300kFull-timePosted 1mo ago

About the role

Town is building the foundational data and retrieval infrastructure for its personalized AI assistant, focusing on a unified search/retrieval layer, durable data models, and scalable pipelines to support context-aware AI across tools and content.

Responsibilities

  • Build the search and retrieval layer that puts the right context at every Townie's fingertips, the moment it's needed — one shared layer the whole product pulls from instead of refetching context on its own.
  • Combine lexical and semantic search and own the tradeoffs between them: vector vs. lexical, precompute vs. fetch, hybrid retrieval, and ranking.
  • Design the durable data model the assistant's work is built on, so context is relevant, fast, and cost-effective.
  • Build and operate the pipelines behind it — realtime/streaming and batch — that keep the index fresh and correct as the underlying data changes.
  • Stand up the indexing and storage layer and keep it fast and reliable at scale: latency, cost, freshness, and completeness.
  • Lay the groundwork for relating content by meaning across everything the assistant knows — the start of a knowledge graph of people, companies, projects, and how they connect.

Qualifications

  • Significant, hands-on experience across lexical and semantic search components and approaches (BM25, embeddings, ANN/vector indexes, hybrid retrieval, ranking).
  • Experience running large-scale data infrastructure, ideally both realtime/streaming and batch — pipelines, indexing, and storage.
  • Ability to make retrieval fast and cheap at scale, with attention to latency, cost, and freshness tradeoffs.
  • Systems thinker comfortable in greenfield environments where foundations don’t exist yet.
  • Experience taking systems from rapid prototype to production scale.
  • Bonus: worked on ranking/relevance, knowledge graphs, or retrieval for LLM or agentic systems.

Skills

Required:Lexical and semantic searchLarge-scale data infrastructureRetrieval systems design
Last updated Sep 1, 2026. Interested? Apply on the company site.
Town logo

About Town

Town | The AI Assistant That Does the Work

Town, the AI assistant that manages your inbox, schedules meetings, and handles busywork — working quietly in the background for you.

AI AssistantInboxesSchedulesAutomationIntegrationsTownieTowniesProductivity
Company profileWebsite

More open roles at Town