← All roles

Research Engineer - Pretraining Data

Prime Intellect· Research
Apply on company site
San Francisco, Remote$150k - $350kFull-timePosted 5d ago

About the role

Role focused on building and curating training data pipelines for Prime Intellect's open models, evaluating data quality and its impact on pretraining, long-context reasoning, and coding capabilities.

Responsibilities

  • Find, evaluate, and collect valuable training data from web, code, and technical sources.
  • Build scalable pipelines that turn raw data into training-ready corpora through extraction, cleaning, deduplication, and filtering.
  • Develop checks for data quality, coverage, and contamination, and use them to improve collection and processing.
  • Work with researchers on data mixtures and sampling strategies for pretraining and midtraining.
  • Prepare and evaluate data for long-context learning, reasoning, and coding, testing synthetic data where it proves useful.
  • Run controlled data experiments and use model evaluations to decide which sources, mixtures, and processing choices are worth scaling.
  • Make large-scale data processing efficient, reproducible, and recoverable, with clear source provenance and dataset versioning.

Qualifications

  • Strong programming skills in Python and a record of building reliable data-processing or distributed systems.
  • Experience working with large datasets and managing the practical tradeoffs of storage, compute, throughput, and reproducibility.
  • Ability to diagnose data-quality issues and translate research goals into measurable checks and experiments.
  • Comfort owning an evolving technical problem end to end and working closely with researchers to test assumptions and improve the system.

Skills

Required:PythonData-processingLarge-scale data handlingData quality and experimentation

Benefits

  • Cash Compensation Range of $150-350k, including equity incentives, aligning your success with the growth and impact of Prime Intellect.
  • Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences and learning opportunities.
  • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.
Last updated Oct 21, 2026. Interested? Apply on the company site.

About Prime Intellect

Commoditizing Compute & Intelligence

Prime Intellect democratizes AI development at scale. Our platform makes it easy to find global compute resources and train state-of-the-art models through distributed training across clusters. Collectively own the resulting open AI innovations, from language models to scientific breakthroughs.

AI developmentbessemer-ai-infrastructure-2026compute resourcesdistributed trainingmodelsreinforcement-learning-platformsscience
Company profileWebsite

More open roles at Prime Intellect