← All roles

AI Engineer, AIOps & Infrastructure

Eloquent AI· Engineering
Apply on company site
Hybrid (San Francisco)$150k - $250kFull-timePosted 11mo ago

About the role

Senior Software Engineer focused on designing, building, and optimizing scalable AI infrastructure to support deployment and operation of enterprise AI agents, with emphasis on LLMOps, MLOps, GPU optimization, and production-ready systems.

Responsibilities

  • Design and build scalable ML infrastructure for deploying and maintaining AI agents in production.
  • Automate LLMOps and MLOps workflows, ensuring seamless model training, fine-tuning, deployment, and monitoring.
  • Optimize GPU and cloud compute workloads, improving efficiency and reducing latency for large-scale AI systems.
  • Develop Kubernetes-based solutions, including custom operators for ML model orchestration.
  • Improve system observability and reliability, implementing logging, monitoring, and performance tracking for AI models.
  • Work with ML and engineering teams to streamline data pipelines, model serving, and inference optimizations.
  • Ensure security, compliance, and reliability in AI infrastructure, maintaining high availability and scalability.
  • Participate in on-call rotations, ensuring 24/7 reliability of critical AI systems.

Qualifications

  • 5+ years of experience in software engineering, MLOps, or infrastructure development.
  • Strong expertise in Kubernetes and experience managing containerized ML workloads.
  • Deep understanding of cloud platforms (AWS, GCP, Azure) and distributed computing.
  • Proficiency in Python, with experience developing services for ML/AI applications.
  • Experience with ML model deployment pipelines, including model serving, inference optimization, and monitoring.
  • Familiarity with vector databases, retrieval systems, and RAG architectures is a plus.
  • Strong problem-solving skills and the ability to work in a high-scale, production-focused AI environment.

Skills

Required:KubernetesPythonML model deployment pipelinesCloud platforms
Nice to have:GPU/workload optimizationVector databases / Retrieval systems / RAG
Last updated Aug 26, 2026. Interested? Apply on the company site.
Eloquent AI logo

About Eloquent AI

The AI Operator for Financial Services

We automate complex, regulated operations in financial services—no APIs, no engineering required. We hit $500K ARR in just four weeks because customers deploy instantly. Our AI Operator learns by observing existing workflows and SOPs, securely controlling browser and desktop applications to automate up to 96% of tasks.

fintechb2benterpriseai
Company profileWebsite

More open roles at Eloquent AI