← All roles

Senior Systems Engineer, Enterprise AI Platforms

CoreWeave· Information Technology
Apply on company site
Hybrid (Sunnyvale, CA), Hybrid (Bellevue, WA)$182k - $242kFull-timePosted 3w ago

About the role

Senior AI Platform Engineer responsible for design, implementation, governance, and operation of CoreWeave's employee-facing AI platforms, with a composite focus on production software & SRE, hands-on LLM/agent work, and enterprise IT controls across identity, devices, and SaaS.

Responsibilities

  • Own the end-to-end lifecycle of employee-facing AI platforms across surfaces (web, desktop, mobile, IDE, terminal, browser): evaluation, procurement support, tenant design, rollout, configuration management, and ongoing operations.
  • Keep the Platforms in Scope list current as the market moves.
  • Establish CoreWeave's AI operating framework for IT: intake and review for new AI tools and agents, standards for internal bots, runbooks, and enablement content.
  • Design and implement AI guardrails as enforceable controls, including SSO and SCIM provisioning, role- and group-based entitlement, data-retention and opt-out settings, policy for browser extensions and desktop apps, and device-trust requirements.
  • Build and operate connector and MCP allowlists across data sources (Okta, Google Workspace, Slack, Atlassian, GitHub, ITSM, HRIS).
  • Translate acceptable-use, data-classification, and regulatory requirements into technical policy; support audits with evidentiary controls.
  • Own the IT-owned control layer for internal chatbots and agents: gateway, identity, secrets, MCP allowlisting, logging, rate limiting, and cost attribution; deploy on CoreWeave infrastructure.
  • Manage inference endpoints, agent hosts, and developer AI tooling on managed devices with lifecycle and observability.
  • Oversee IT-owned MCP servers, reusable agent skills, and shared agent configuration; ensure identity, logging, and allowlisting standards are met by other teams.
  • Operate AI services to meet SRE standards: automation and infrastructure-as-code, reliability targets, on-call, incident response.
  • Instrument usage, cost, quality, and risk telemetry; develop dashboards and alerts for leadership.
  • Serve as senior escalation point for AI tooling issues.
  • Communicate clearly with executives, cross-functional partners, and employees.

Qualifications

  • 6+ years in software engineering, site reliability engineering, or IT systems engineering with code-based work.
  • 2+ years hands-on experience with LLM-based products: API integration, prompt/tool design, retrieval pipelines, agent frameworks, multi-agent workflows, or enterprise administration of tools (e.g., Claude, ChatGPT Enterprise, Copilot, Gemini, Glean, Rovo).
  • Strong software engineering skills in Python, Go, Rust, or TypeScript; built services and integrations with ongoing reliability.
  • Experience operating production services (containers, IaC, CI/CD, secrets management, observability) or automating enterprise systems with code (e.g., Terraform for Okta/Google Workspace).
  • Understanding of enterprise IT control systems: SSO/SCIM/SAML/OIDC/OAuth, device trust, zero trust, MDM, and SaaS administration (Google Workspace, Slack, Atlassian, GitHub).
  • Proven ability to produce clear technical documentation and lead complex cross-functional technical initiatives.

Skills

Required:AI platform governanceSRE / IaCIdentity & Access management

Benefits

  • Medical, dental, and vision insurance - 100% paid by CoreWeave
  • Company-paid Life Insurance
  • Voluntary supplemental life insurance
  • Short and long-term disability insurance
  • Flexible Spending Account
  • Health Savings Account
  • Tuition Reimbursement
  • Ability to Participate in Employee Stock Purchase Program (ESPP)
  • Mental Wellness Benefits through Spring Health
  • Family-Forming support provided by Carrot
  • Paid Parental Leave
  • Flexible, full-service childcare support with Kinside
  • 401(k) with generous employer match
  • Flexible PTO
  • Catered lunch daily at office/data center locations
  • Casual work environment
  • A work culture focused on innovative disruption
Last updated Sep 30, 2026. Interested? Apply on the company site.

About CoreWeave

The Essential Cloud for AI

CoreWeave is the force multiplier that empowers pioneers with momentum, magnitude, and mastery—enabling them to innovate with confidence. Explore the #1 AI Cloud.

AI CloudCluster ManagementGPU computeManaged ServicesNetworkingPlatformStorageliquid-ai-recruiting-target
Company profileWebsite

More open roles at CoreWeave