← All roles

Senior Prompt Engineer

Welocalize· Welo Data - AI Services – Data Validation
Apply on company site
Germanypart-timePosted 7mo ago

About the role

Seeking a prompt engineer responsible for migrating templates to LLM autoraters, leveraging prompt engineering techniques to optimize model performance.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus.
  • Manually draft, test, and refine prompts to handle complex architectures and edge cases.
  • Monitor shadowbot runs for disagreements between human and LLM ratings.
  • Run prompt versions against gold data to measure autorater quality, calculating accuracy metrics.
  • Draft technical launch readiness justifications (Launch Certification Documentation).

Qualifications

  • Native fluency in German and fluent in English.
  • Based in Germany.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Linguistics, HCI, Cognitive Science, or related field.
  • At least 4 years' experience as Prompt Engineer with proven tuning of LLMs for structured outputs, classification tasks, chain-of-thought, and few-shot learning.
  • Strong proficiency in error pattern analysis, model performance evaluation, using SQL or data analytics tools.
  • Ability to quickly learn and master proprietary tools.
  • Excellent verbal and written communication skills.

Skills

Required:Prompt EngineeringData Analysis
Last updated Apr 1, 2026. Interested? Apply on the company site.

About Welocalize

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
Company profileWebsite

More open roles at Welocalize