← All roles

Senior Prompt Engineer

Welocalize· Welo Data - AI Services
Apply on company site
RemotePart-Time, Freelance, RemotePosted 7mo ago

About the role

Responsible for end-to-end technical migration workflow for transitioning templates to LLM autoraters, leveraging prompt engineering techniques to optimize model performance.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tools, review outputs, flag deadlocks or plateaus.
  • Manually draft, test, and refine prompts to handle complex scenarios and edge cases.
  • Monitor shadowbot runs to ensure model disagreements are registered and tracked.
  • Run prompt versions against gold data to measure autorater quality using metrics like F1, precision, and recall.
  • Draft technical launch readiness documents (Launch Certification Documentation).

Qualifications

  • Native fluency in English.
  • Must be based in United States.
  • Bachelor’s, Master’s, or Doctorate in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science or related field.
  • At least 4 years' experience as Prompt Engineer.
  • Proven experience tuning Large Language Models (LLMs).
  • Strong proficiency in data analysis, error pattern identification, and using SQL or similar tools.
  • Ability to quickly learn and master proprietary tools.
  • Excellent verbal and written communication skills.

Skills

Required:Prompt EngineeringData AnalysisCommunication SkillsProprietary Tool Mastery
Last updated Apr 1, 2026. Interested? Apply on the company site.

About Welocalize

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
Company profileWebsite

More open roles at Welocalize