Senior Machine Learning Engineer
Cresta· Engineering
Remote$205k - $270kFull-timePosted 3mo ago
About the role
Senior ML Engineer role at Cresta focusing on building next-generation AI Agents, agentic assist systems, and enterprise-grade ML capabilities across agentic/LLM workflows, evaluation, and retrieval-augmented generation pipelines. Remote (United States).
Responsibilities
- Lead the design and development of Cresta’s next-generation AI Agents and Agentic Assist systems, defining system architecture and core modeling approaches.
- Architect intelligent, multi-step agent workflows that combine real-time guidance, knowledge retrieval, reasoning, summarization, and automated actions into cohesive production systems.
- Design, deploy, and optimize LLM-powered systems, including Retrieval-Augmented Generation (RAG) pipelines, multi-agent orchestration, and domain-adapted models.
- Improve reasoning, planning, and tool-use capabilities in real-world AI applications.
- Develop evaluation strategies for complex, non-deterministic systems, including offline benchmarking, online experimentation, and LLM-as-a-judge methodologies.
- Diagnose and mitigate real-world failure modes such as hallucinations, retrieval errors, tool misuse, prompt brittleness, and multi-step reasoning breakdowns.
- Define and measure quality metrics (e.g., accuracy, faithfulness, task completion, latency, cost, robustness) to improve system reliability and performance.
- Optimize AI systems for scalability, latency, security, and cost efficiency in production environments.
- Collaborate cross-functionally with product, frontend, and backend teams to integrate AI capabilities seamlessly into Cresta’s platform.
- Mentor engineers, contribute to technical strategy, and help shape the roadmap for Cresta’s AI systems.
Qualifications
- Bachelor’s degree in Computer Science, Mathematics, or a related field; Master’s or Ph.D. preferred.
- 5–8+ years of industry experience building and deploying machine learning systems in production, including significant experience working with LLMs.
- Strong expertise in NLP, Generative AI, transformer architectures, embeddings, and retrieval systems.
- Proven experience designing and deploying Retrieval-Augmented Generation (RAG) systems in enterprise environments.
- Experience building and evaluating complex agentic or multi-step LLM workflows.
- Strong knowledge of modern ML frameworks and tools (e.g., PyTorch, TensorFlow, Hugging Face) and distributed/cloud-based infrastructure.
- Demonstrated ability to optimize real-time ML systems for performance, scalability, and reliability.
- Strong technical leadership skills, with the ability to influence cross-functional decisions and raise the engineering bar.
Skills
Required:LLMs and promptingRetrieval-Augmented Generation (RAG)NLP, transformer architectures, embeddingsMulti-agent workflows
Benefits
- Comprehensive medical, dental, and vision coverage
- Flexible PTO
- Paid parental leave
- Retirement savings plan
- Remote work setup budget
- Monthly wellness and communication stipend
- In-office meal program and commuter benefits for onsite employees
Last updated Sep 17, 2026. Interested? Apply on the company site.
About Cresta
AI Agents for Every Customer Conversation | Cresta
AI Agents for Every Customer Conversation | Cresta
AIAI AgentAutomationCXCrestaCustomer ExperiencePlatformorchestration
More open roles at Cresta
- Senior Technical Product Marketing Manager, AI Agent3d agoHybrid (New York, NY; San Francisco, CA; United States) · Marketing
- Senior Product Marketing Manager, Vertical Solutions3d agoHybrid (New York, NY; San Francisco, CA; United States) · Marketing
- Senior Product Marketing Manager, Healthcare3d agoHybrid (New York, NY), Hybrid (San Francisco, CA) +1 more · Marketing
- Senior Mobile Software Engineer - Android & iOS3d agoHybrid (Canada & United States) · Engineering
- Enterprise Solutions Engineer1w agoRemote · Sales