← All roles

Lead Prompt Engineer

Welocalize· Welo Data - AI Services
Apply on company site
Hybrid (United States)freelancePosted 7mo ago

About the role

A role focused on guiding a team through AI model integration, particularly in prompt engineering and optimization for large language models with a focus on technical migration, performance, and strategy.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus.
  • Manually draft, test, and refine prompts to navigate complex template architectures, overcome anti-patterns, and handle edge cases.
  • Monitor shadowbot runs to ensure sufficient disagreements are registered and tracked.
  • Run prompt versions against gold data to measure autorater quality, calculate F1 scores, precision, and recall.
  • Draft technical launch readiness justifications (Launch Certification Documentation) for final approval.

Qualifications

  • Native fluency in English.
  • Must be based in United States.
  • Master’s or Doctorate degree in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science, or related field.
  • At least 7 years' experience as Prompt Engineer, with proven experience tuning LLMs for structured outputs and complex classification.
  • Strong proficiency in data analysis, error pattern identification, and using SQL or analytics tools.
  • Ability to quickly learn and master proprietary tools.
  • Excellent verbal and written communication skills.

Skills

Required:Prompt EngineeringAI Model TuningData AnalysisCommunication Skills
Last updated Apr 6, 2026. Interested? Apply on the company site.

About Welocalize

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
Company profileWebsite

More open roles at Welocalize