Member of Technical Staff, Machine Learning
New York, New York$160k - $250kFull-timePosted 10mo ago
About the role
AI/ML Engineer role focused on designing, building, and deploying large-scale NLP and LLM systems to power classification, ranking, clustering, topic discovery, and content generation for an AI marketing platform.
Responsibilities
- Build and deploy NLP models at scale for classification, ranking, clustering, topic extraction, and summarization
- Design LLM workflows for context and content generation end to end, including topic discovery, brief creation, outlines and drafts, revision loops, and publish-ready assets
- Develop prompt and template libraries aligned to brand voice and channel, including blogs, landing pages, help docs, and ads, with retrieval for evidence-grounded generation and citations
- Create evaluation frameworks for generated content, including factuality, coverage, tone, safety, and originality, with rubric-based LLM evaluations, human-in-the-loop review, and red teaming
- Instrument content performance across AEO and SEO visibility, engagement, and conversion, and run experiments to improve quality, cost, and latency
- Transform large text datasets into production features and signals that drive product insights
- Partner with engineering to instrument events, maintain data pipelines, and uphold high data quality and observability
- Collaborate with product, data, and go-to-market teams on success metrics and experiments that move customer-facing KPIs
Qualifications
- Proven experience shipping machine learning systems in production at scale, especially with large text data
- Hands-on experience building LLM content systems including prompting, templating, retrieval or RAG, guardrails, and evaluations
- Fluency in SQL and strong Python skills with modern machine learning tooling
- Strong grasp of machine learning and generation quality metrics, with the ability to design offline and online evaluations and monitoring
- Ability to innovate when off-the-shelf solutions do not fit the problem
- Experience working in cross-functional, high-performance teams
- Clear communication with both technical and non-technical partners
- Ownership mindset and comfort operating in a fast-paced environment
- Excited by ownership of the entire product analytics function at an early stage company
- Motivated by shaping how usage is measured and how product decisions are made
- Interested in close collaboration with product, engineering, and go-to-market teams
- Comfortable in a fast-paced environment with trust, autonomy, and responsibility
- Drawn to competitive compensation and meaningful equity
Skills
Required:SQLPythonNLP/LLMEvaluation frameworksData pipelines
Last updated Sep 16, 2026. Interested? Apply on the company site.
About Profound
Optimize Your Brand's Visibility in AI Search
Profound helps brands gain visibility in AI-generated answers, optimize their presence in LLM-based answer engines, and stay competitive in the zero-click world.
AI VisibilityAnswer Engine OptimizationGenerative SEOAI Search OptimizationLLM optimization
More open roles at Profound
- G&A Recruiter4d agoNew York, New York, San Francisco, California · Recruiting
- Member of Technical Staff, Engineering Manager4d agoNew York, New York · Engineering
- Manager, Forward Deployed Marketing Engineers1w agoNew York, New York, San Francisco, California +1 more · Customer Success
- Head of Design1w agoNew York, New York · Design
- GTM Enablement Program Manager1w agoNew York, New York · Sales