← All roles

Senior DevOps Engineer, AI Platform

FloQast· Engineering – DevOps
Apply on company site
Hybrid (San Jose, CA)$186k - $282kFull-timePosted 2mo ago

About the role

DevOps role with an AI infrastructure specialization focused on building fast, observable, multi-region, cost-bounded, and auditable AI runtimes for FloQast's AI products (Transform, AI Matching, AutoBuilder). Not a research or modeling role; owns AI runtime infrastructure, sandboxed execution, and related CI/CD, observability, security, and cost engineering.

Responsibilities

  • AI runtime infrastructure: manage AWS Bedrock and Bedrock AgentCore across US, EU, AU; model access, throughput, cross-region inference, quotas/throttles, and data residency considerations.
  • Sandboxed execution: operate AI-generated code execution environments with session lifecycle limits, network controls, and least-privilege IAM.
  • Infrastructure as code: write/review Terraform across a multi-account, multi-region AWS estate; provision AI resources via code.
  • Observability for AI workloads: extend Grafana signals for AI systems; define SLOs based on user journeys.
  • Cost engineering: treat AI spend as a cost line; tag for per-business-unit and tenant attribution in FinOps tooling.
  • CI/CD and delivery: build GitHub Actions pipelines for Node/TypeScript and Python services; version, gate, and feature-flag model/prompt changes.
  • Reliability and on-call: participate in on-call rotation; write AI-specific runbooks for failure modes; plan capacity for month-end close.
  • Security, compliance, and tenancy: SOC 2 and ISO 27001/42001 compliance; enforce tenant isolation; audit logging and encryption.

Qualifications

  • 5+ years in DevOps, SRE, platform, or infrastructure engineering (production on-call experience).
  • Deep, hands-on AWS: ECS/Fargate, Lambda, SQS, S3, IAM, VPC/networking, ALB/NLB.
  • Terraform at production scale: modules, state management, multi-region, multi-account.
  • CI/CD and container ownership: GitHub Actions preferred, Docker, image supply chain, scaling policies.
  • Production AI infrastructure: operated at least one LLM-backed or ML-serving workload; knowledge of tokens, latency, throttling, and cost; experience with Bedrock, Vertex, Azure OpenAI, Anthropic; serving platforms like SageMaker, KServe, Ray Serve, vLLM, Triton, TrueFoundry; eval harnesses in CI.
  • Observability practice: Grafana/Prometheus/OpenTelemetry, distributed tracing; define SLOs measuring user experience.
  • Programming: Python or TypeScript/Node.js fluent enough to read/debug services and contribute PRs.

Skills

Required:AWS (ECS/Fargate, Lambda, SQS, S3, IAM, VPC, networking, ALB/NLB)TerraformCI/CD (GitHub Actions)ContainerizationAI infrastructureObservabilityPython/TypeScript

Benefits

  • Medical, Dental, Vision
  • Family Forming benefits
  • Life & Disability Insurance
  • Unlimited Vacation
  • Employee Stock Program
Last updated Oct 21, 2026. Interested? Apply on the company site.

About FloQast

The First Accounting Transformation Platform Powered by AI Agents

FloQast | The Accounting Transformation Platform

AIaccountingautomationcollaboration
Company profileWebsite

More open roles at FloQast