← All roles

Senior Prompt Engineer

Welocalize· Welo Data - AI Services
Apply on company site
RemotePart-TimePosted 7mo ago

About the role

Seeking a Prompt Engineer responsible for managing and optimizing prompt workflows for transitioning templates to LLM autoraters, leveraging internal tools and techniques to enhance model performance.

Responsibilities

  • Utilize Automatic Prompt Generation (APG) tools to create baseline prompts for complex template clusters.
  • Run and supervise Automated Prompt Optimization (APO) tools, reviewing outputs, and flagging deadlocks or plateaus.
  • Manually draft, test, and refine prompts to handle complex architectures, anti-patterns, and edge cases.
  • Monitor shadowbot runs to ensure proper disagreement registration between humans and LLM ratings.
  • Run prompt versions against gold data to measure quality, calculating metrics like F1, precision, and recall.
  • Draft technical launch readiness documentation.

Qualifications

  • Native fluency in Japanese and fluent in English.
  • Bachelor’s, Master’s, or Doctorate in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science, or related fields.
  • At least 4 years' experience as Prompt Engineer.
  • Proven experience tuning LLMs for structured outputs and complex tasks.
  • Strong proficiency in data analysis tools like SQL.
  • Ability to quickly learn proprietary tools.
  • Excellent verbal and written communication skills.

Skills

Required:Prompt EngineeringData AnalysisEnglish and Japanese Language FluencyTechnical Mastery of Proprietary Tools
Last updated Apr 6, 2026. Interested? Apply on the company site.

About Welocalize

Bridging language & AI to power global success.

Bridging language & AI to power global success. Our expertise in localization & AI data ensures scalable solutions for businesses worldwide.

TranslationLocalizationAI Data TrainingMedical TranslationLegal TranslationMultilingual ContentAI Training Data
Company profileWebsite

More open roles at Welocalize