← All roles

Senior Prompt Engineer

Welocalize· Welo Data - AI Services
Apply on company site
FrancePart-TimePosted 7mo ago

About the role

Responsible for end-to-end technical migration workflow of templates to LLM autoraters, leveraging prompt engineering techniques to optimize model performance.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus.
  • Manually draft, test, and refine prompts to navigate complex template architectures, address anti-patterns, and handle edge cases.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are registered, generated, and tracked.
  • Run prompt versions against established gold data to measure autorater quality, calculating accuracy metrics such as F1 scores, precision, and recall.
  • Draft technical launch readiness justifications (Launch Certification Documentation).

Qualifications

  • Native fluency in French and fluent in English.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science, or related field.
  • At least 4 years' experience as Prompt Engineer with proven experience tuning Large Language Models (LLMs).
  • Proven expertise in structured outputs, classification tasks, chain-of-thought, and few-shot learning.
  • Strong proficiency in data analysis, error pattern identification, and SQL or similar tools.
  • Ability to quickly learn proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.

Skills

Required:Prompt EngineeringData AnalysisLanguage Skills - French and English
Last updated Apr 1, 2026. Interested? Apply on the company site.

About Welocalize

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
Company profileWebsite

More open roles at Welocalize