Prompt Engineer
Welocalize· Welo Data - AI Services
RemotePart-TimePosted 7mo ago
About the role
Seeking a Prompt Engineer responsible for technical migration workflows, prompt engineering, and model performance optimization for large language models in a remote, part-time role.
Responsibilities
- Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
- Run and supervise Automated Prompt Optimization (APO) tool, review outputs, and flag deadlocks or plateaus.
- Manually draft, test, and refine prompts to handle complex templates, anti-patterns, and edge cases.
- Monitor shadowbot runs to ensure sufficient disagreements are registered, generated, and tracked.
- Run prompt versions against established gold data to measure autorater quality, calculating accuracy metrics such as F1, precision, and recall.
- Draft technical launch readiness justifications (Launch Certification Documentation) for final approval.
Qualifications
- Native fluency in English.
- Must be based in United States.
- Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction, Cognitive Science, or related field.
- At least 2 years' experience as Prompt Engineer, with proven experience tuning Large Language Models (LLMs).
- Experience with structured outputs, complex classification tasks, chain-of-thought, and few-shot learning.
Skills
Required:Prompt EngineeringLarge Language Models (LLMs)Data AnalysisEnglish Fluency
Last updated Apr 6, 2026. Interested? Apply on the company site.
About Welocalize
Bridging language & AI to power global success.
Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.
TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
More open roles at Welocalize
- AI Content Evaluator - Tajik (Uzbekistan)6mo agoRemote · Welo Data – AI Services
- HR Director6mo agoRemote · Welo Data – Sourcing & Talent
- 6mo ago
- Lithuanian Localization QA Tester / Proofreader6mo agoRemote · Corporate – Production
- Bulgarian Localization QA Tester / Proofreader6mo agoRemote · Corporate – Production