Senior Prompt Engineer

Welocalize· Welo Data - AI Services

Hybrid (Italy)Part-TimePosted 7mo ago

About the role

Seeking a Prompt Engineer responsible for migrating templates to LLM autoraters, using prompt engineering techniques to enhance model performance.

Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex template clusters.
Run and supervise Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus.
Manually draft, test, and refine prompts for complex architectures and edge cases.
Monitor shadowbot runs to ensure sufficient disagreement data.
Run prompt versions against gold data to measure autorater quality, calculating metrics such as F1, precision, and recall.
Draft technical launch readiness justifications (Launch Certification Documentation).

Native fluency in Italian and fluent in English.
Bachelor’s, Master’s, or Doctorate in Computer Science, Data Science, Linguistics, HCI, Cognitive Science, or related field.
At least 4 years' experience as Prompt Engineer with proven LLM tuning experience.
Strong proficiency in data analysis, skill in SQL or analytics tools.
Ability to quickly learn proprietary tools.
Excellent verbal and written communication skills.

Required:Prompt EngineeringData AnalysisCommunication Skills

Last updated Apr 1, 2026. Interested? Apply on the company site.

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data