← All roles

Member of Technical Staff (Backend Software Engineer, Search Crawler)

Perplexity· Search
Apply on company site
Belgrade, London, BerlinFull-timePosted 11mo ago

About the role

Experienced Backend Software Engineer to join the Crawler team. Design, develop, and operate systems that ingest, process, and manage web-scale data for advanced search technologies. Focus on both backend and frontend components of the data acquisition stack.

Responsibilities

  • Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
  • Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
  • Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
  • Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
  • Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.

Qualifications

  • Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
  • Experience with large-scale web crawlers is highly desirable.
  • Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
  • Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
  • Demonstrated passion for writing clean, efficient, and scalable systems.

Skills

Required:software developmentPythonC++Distributed systemsKubernetes (K8s)AWS
Nice to have:RustGo
Last updated Sep 30, 2026. Interested? Apply on the company site.

About Perplexity

ai-plg-top-20brex-fastest-growing-2025liquid-ai-recruiting-targetsetter-30setter-30-2026-q1
Company profileWebsite

More open roles at Perplexity