← All roles

Audio QA Lead - Part Time Contractor

Besimple AI· Operations
Apply on company site
Hybrid (San Mateo, CA)$25/hr - $45/hrContractPosted 4mo ago

About the role

Part-time contractor role to develop and ensure high-quality training datasets for voice AI, focusing on audio quality standards, recording on-demand, and annotation/QA across speech datasets for applications like TTS, ASR, transcription, and conversational voice systems. Potential path to full-time.

Responsibilities

  • Develop, refine, and apply audio quality guidelines for speech and voice datasets.
  • Review audio files against technical, linguistic, and task-specific standards, approving, rejecting, or revising as needed.
  • Identify audio and annotation issues (background noise, clipping, distortion, plosives, echo, low signal, segmentation errors, transcript mismatches, speaker-label inconsistencies).
  • Perform annotation and QA tasks (transcription, timestamp validation, VAD/segmentation, diarization, pronunciation checks, metadata review).
  • Record speech based on scripts and guidelines to deliver natural, high-quality, specification-compliant audio.
  • Document edge cases, update review rubrics, and improve SOPs and quality standards.
  • Collaborate with research, ML, and operations teams to translate model requirements into data specifications and evaluation criteria.
  • Ensure consistency and integrity across audio files, transcripts, annotations, and metadata.

Qualifications

  • Direct experience working with audio AI training datasets or evaluation workflows.
  • Hands-on experience with TTS, ASR, transcription, speech-to-speech, or related voice AI systems.
  • Experience developing or applying audio quality standards in production environments.
  • Experience with speech annotation tasks (transcription, timestamp QA, VAD/segmentation, diarization).
  • Strong auditory judgment with ability to identify subtle audio quality issues.
  • Ability to produce high-quality recordings in a controlled, quiet environment using professional or near-professional equipment.
  • Strong written communication skills for clear, actionable feedback.
  • High attention to detail and sound judgment for edge cases.
  • Comfort with structured data formats such as spreadsheets, CSV, or JSON.

Skills

Required:Audio quality assessmentTranscriptionTimestamp validationVAD/segmentation
Nice to have:Diarization
Last updated Oct 21, 2026. Interested? Apply on the company site.
Besimple AI logo

About Besimple AI

Expert-in-the-loop eval data for AI

Besimple AI helps teams ship AI with confidence by making high-quality, human-in-the-loop data fast, flexible, and scalable. We’re not a generic annotation vendor—we’re your on-demand evaluation and safety data engine. In under a minute, you can spin up your own data-annotation workspace tailored to your workflow, so your team can move from “we think it works” to measurable, repeatable results. Modern AI changes quickly. Models evolve, prompts shift, and new edge cases appear the moment you go live. Besimple is built for that reality. Our platform generates task-specific annotation experiences aligned to your data and goals, so you can capture reliable judgment on everything from factuality and safety to preference and policy compliance. The result is an always-current evaluation loop that keeps pace with your product, rather than a one-off test that goes stale. We specialize in evaluation and expert-grade safety data—not commodity labeling. That means we recruit and train domain experts and SMEs to judge model outputs against high bars, and we design the interfaces and guidelines to make those judgments consistent, auditable, and useful for both offline evals and production monitoring. Your team shouldn’t be waiting on back-and-forth specs and custom tooling. With Besimple, you can paste or stream your data, click to generate a tailored interface, and start collecting ground truth right away. When the task changes, the UI adapts with it. We combine pragmatic product design with a human-in-the-loop operating model. Besimple helps you create clear, actionable guidelines and then enforces them with workflow guardrails, reviewer consensus, and targeted spot-checks—so you can trust the numbers you ship. Because we’re built for iterative work, teams can quickly compare prompts, models, and policies; spot regressions; and push fixes backed by fresh, expert-reviewed data. Great models don’t happen by accident—they’re the product of tight feedback loops, expert judgment, and tooling that bends to your data, not the other way around. If you’re ready to replace slow, one-size-fits-all processes with a purpose-built evaluation and safety engine, Besimple gives you the fastest path from raw data to reliable decisions—so you can iterate boldly and ship with confidence.

aiopsartificial-intelligencedata-labeling

More open roles at Besimple AI