Research Engineer - Web Crawlers
RemoteFull-timePosted 1mo ago
About the role
Research Engineer role focused on large-scale web crawling to source high-quality data for frontier AI models. Own crawling systems, solve complex crawling challenges, and build pipelines to convert crawled data into clean, training-ready datasets.
Responsibilities
- Building and operating large-scale, distributed web crawlers that discover, fetch, and extract data across billions of pages reliably and efficiently.
- Solving hard crawling problems such as content extraction from messy HTML, deduplication at web scale, freshness and recrawl strategies, and politeness and rate-limit handling.
- Designing targeted crawling pipelines that find high-value data sources, including audio, video, and multilingual content, and turn them into clean training-ready datasets.
- Creating tooling and infrastructure that lets researchers request, monitor, and explore newly crawled web data quickly and reliably.
Qualifications
- Hands-on experience building and scaling web crawlers or scraping systems, ideally in support of machine learning training data.
- Strong engineering skills in distributed systems at scale (e.g., Kubernetes, queue-based architectures, or custom pipelines processing billions of documents).
- The capacity to autonomously evaluate the quality, coverage, and compliance of crawled data, and to build the tooling to measure it.
Skills
Required:Distributed systemsWeb crawling / scrapingData quality assessment
Benefits
- Annual discretionary professional development stipend.
- Annual discretionary social travel stipend.
- Annual company offsite in a new location.
- Monthly co-working stipend for remote staff.
Last updated Oct 8, 2026. Interested? Apply on the company site.
About ElevenLabs
Free AI Voice Generator & Voice Agents Platform | ElevenLabs
Create lifelike speech with our AI voice generator and voice agents platform. Access 5,000+ voices in 70+ languages with secure APIs and SDKs.
AI Voice AgentsAPIAPI ReferenceAboutAffiliatesAgents PlatformAudio NativeBlog
More open roles at ElevenLabs
- Revenue Partnerships - Southern Latam4d agoArgentina · Revenue
- Account Executive - Enterprise - Sports Specialist4d agoRemote, New York +1 more · Revenue
- Enterprise Account Executive - Japan4d agoRemote · Revenue
- Adoption Strategist - North America4d agoRemote · Revenue
- GTM Enablement - Sales Execution & North America Lead4d agoRemote, New York · Revenue