← All roles

Staff Software Engineer, Cortex AI Search Infrastructure

Snowflake Inc.· Engineering
Apply on company site
Hybrid (US-CA-Menlo Park)$236k - $339.3kFull-timePosted 5mo ago

About the role

Role focused on building high-performance AI search infrastructure for Snowflake Cortex, including retrieval-augmented generation and agentic runtimes, with emphasis on scalable, secure, multi-tenant systems and observability.

Responsibilities

  • Architect Agentic Runtimes: Build and scale the orchestration engines that execute complex agentic workflows, ensuring low-latency tool execution and robust state management.
  • Scale Context Engineering Infra: Design high-performance systems for RAG (Retrieval-Augmented Generation), including vector database integration, scalable and efficient search indexing, query processing, and result ranking, semantic caching, and automated metadata extraction.
  • Build the "Evals Engine": Develop the automated infrastructure required to run massive-scale golden set simulations, error analysis pipelines, and "hillclimbing" experiments.
  • Productionize AI Workflows: Collaborate with the modeling team to take raw LLM capabilities and turn them into hardened, multi-tenant microservices with strict guardrails and observability.
  • Optimize Performance & Cost: Direct the infra strategy for model routing, prompt caching, and token optimization to ensure Snowflake’s AI features are the most efficient in the industry.

Qualifications

  • Bachelor’s degree in Computer Science or a related technical field.
  • 9 + years of experience building distributed systems, high-throughput APIs, or backend infrastructure for AI/ML products.
  • Deep proficiency in Go or Java (for systems) and Python (for AI orchestration).
  • Strong understanding of database internals, distributed state management, and cloud-native architecture (Kubernetes, FoundationDB, etc.).
  • Familiarity with the "plumbing" of AI: vector indices, agent platforms, and building scalable data pipelines.

Skills

Required:GoJavaPythonDistributed systemsGo/Java and Python integration for AI workflows
Last updated Aug 20, 2026. Interested? Apply on the company site.

About Snowflake Inc.

The Data Platform Built for Data Teams.

Snowflake powers AI, data engineering, applications, and analytics on a trusted, scalable AI Data Cloud—eliminating silos and accelerating innovation.

AIData CloudData EngineeringAnalyticsApplications & Collaboration
Company profileWebsite

More open roles at Snowflake Inc.