← All roles

Staff AI Platform Engineer, Infrastructure Services

SentinelOne
Apply on company site
Remote/Hybrid option unclear from description$156k - $215kFull-timePosted 2mo ago

About the role

Staff AI Platform Engineer responsible for owning and evolving the AI Gateway infrastructure (Kong AI Gateway) and enabling the broader AI infrastructure across CI/CD, GitOps, and artifact systems. High autonomy role focusing on technical direction, reliability, and cross-functional collaboration to support AI tooling, self-hosted model serving, and AI lifecycle workflows.

Responsibilities

  • Work on the AI Gateway platform: architect, harden, and scale our Kong AI Gateway deployment (Konnect Hybrid on KCP/EKS), including auth (Okta/OIDC), consumer tiers and budgets, rate limiting, semantic caching, and observability.
  • Lead reliability and incident response: drive root-cause analysis and remediation for gateway issues (timeouts, latency, capacity, failover) and build the monitoring/alerting needed to catch them before users do.
  • Design across the platform, not just the gateway: work fluently with our CI/CD (Jenkins, JPAAS), GitOps and Kubernetes deployment tooling (ArgoCD across dev/gov/prod), artifact management (Artifactory/Xray), GitHub Enterprise administration, and GitHub Actions runner fleet, so that AI infrastructure decisions account for how the rest of the platform actually works.
  • Evaluate and roll out AI developer tooling: run structured pilots and adoption efforts for tools like AI-assisted PR review (Qodo) and engineering metrics platforms (LinearB), and make clear build-vs-buy recommendations.
  • Set technical direction and mentor: define architecture and standards for AI infrastructure, review designs across the team, and raise the bar for other engineers working in this space.
  • Partner cross-functionally: work directly with security, DevEx, and product engineering teams consuming the gateway to translate their needs into platform capabilities.
  • Host and serve local models: stand up and operate self-hosted/open-weight model serving infrastructure (e.g. vLLM, NVIDIA Triton/NIM, TGI, Ollama) for workloads where routing to an external provider isn't the right fit, including GPU capacity planning, autoscaling, and cost/performance tuning.
  • Support the broader model lifecycle: help build LLMOps practices such as model versioning, evaluation, and safe rollout, plus supporting infrastructure for retrieval-augmented generation (vector stores, embedding pipelines) as use cases mature.
  • Track usage and cost: build observability into token usage, latency, and spend across both API-based and self-hosted models so the business can see what AI infrastructure actually costs.

Qualifications

  • 8+ years of experience in platform, infrastructure, or DevOps engineering with end-to-end production ownership.
  • Hands-on experience with API gateway technologies (Kong, Envoy, Apigee, or similar) and AI/LLM gateway patterns (rate limiting, semantic caching, observability).
  • Strong Kubernetes and GitOps experience (ArgoCD); comfortable in dev/gov/prod environments.
  • Solid CI/CD background (Jenkins, build infra, runner fleet management such as GitHub Actions runners).
  • Experience with artifact/package management (Artifactory, Xray) and GitHub Enterprise administration.
  • Working knowledge of infrastructure-as-code (Terraform) and cloud platforms (AWS/EKS).
  • Experience deploying self-hosted LLM inference stacks (vLLM, Triton/NIM, TGI, Ollama) with GPU scheduling and autoscaling.
  • Familiarity with LLMOps practices: model versioning, evaluation, and usage/cost observability across API-based and self-hosted models.

Skills

Required:AI Gateway platformsKubernetesGitOps (ArgoCD)CI/CD (Jenkins, GitHub Actions)Artifact/Package ManagementCloud/AWS/EKSSelf-hosted LLM stacks
Nice to have:TerraformLLMOpsDeveloper tooling (Qodo, LinearB)

Benefits

  • Equity & Rewards: RSUs, ESPP
  • Time Off & Wellbeing: Flexible time off, paid holidays and sick time, parental leave, grandparent leave
  • Insurance & Financial Security: Medical/dental/vision, 401(k) with match, life/disability insurance, FSA, voluntary benefits, EAP, legal plan, pet insurance, cancer care program, travel medical insurance
  • Work Perks & Flexibility: Home office allowance, mobile phone reimbursement
  • Wellness & Lifestyle: Wellness coach, gym reimbursement, fertility coverage, adoption & surrogacy reimbursement
Last updated Oct 22, 2026. Interested? Apply on the company site.
SentinelOne logo

About SentinelOne

AI-Powered Enterprise Cybersecurity Platform

SentinelOne unifies AI-powered endpoint, cloud, identity, and data protection—enhanced by our Security Data Lake for seamless and efficient cybersecurity.

CybersecurityAI SecurityEndpoint SecurityCloud SecurityAI-SIEMIdentity SecurityEDRXDR
Company profileWebsite

More open roles at SentinelOne