Forward Deployed Engineer: AI + HPC
About the role
Forward Deployed Engineer at Cedana focusing on end-to-end technical engagements with customers to deploy and operate Cedana’s AI+HPC infrastructure across SLURM, Kubernetes, and Dynamo environments.
Responsibilities
- Engineer solutions at client sites: Lead customer integrations. Install, configure, and deploy Cedana into SLURM, Kubernetes, and Dynamo environments.
- Drive product innovation from the field: Identify technical gaps while embedded with clients, then provide product feedback for new capabilities that become core product features.
- Measure and optimize platform performance: Measure reliability, throughput, and performance using internal tools. Design and implement policy-based migration automations to optimize reliability, throughput, and performance.
- Own critical deployments: Ensure platform reliability for clients' critical operations, debugging issues across the full stack; escalate to engineering when necessary.
- Improve scalability: Build and own the internal installation playbook to onboard subsequent customers faster.
- Respect our customers: Understand how to make their lives easier and minimize their time and overhead.
Qualifications
- 3-10 years of software engineering experience with a track record of configuring and managing SLURM deployments.
- Production experience in standing up SLURM in a customer or research environment (slurmctld, slurmdbd, accounting, cgroup integration, GPU resource selection).
- Strong Linux fundamentals (systemd, cgroups v2, namespaces, networking, filesystems, firewalls, kernel module loading, PAM). Reading strace and dmesg outputs to form hypotheses.
- Experience with Kubernetes operations including operators, CRDs, CNIs, device plugins, and node-level debugging; able to debug a controller in production.
Skills
Benefits
- 100% covered medical, dental, and vision insurance for employees and families
- Unlimited PTO policy
- 401K Plan
About Cedana
Fast, reliable, reproducible AI with GPU live migration
Cedana (YC S23) brings hyperscaler and frontier-lab orchestration capabilities for AI workflows. Our core capability is live migration for CPUs and GPUs workloads. This increases cost savings up to 80%, accelerates time to first token 2-10x, and enables stateful reliability of training jobs even through catastrophic GPU failures. We've integrated our solution into K8s, and support Kueue and Slurm for training distributed jobs, and Kserve for serving inference. OpenAI, Meta and Microsoft have flavors of these capabilities internally and we’re bringing them to everyone. Our vision is to transform cloud compute into a real-time, arbitraged commodity. https://www.cedana.ai
More open roles at Cedana
- Systems Engineer: Linux Kernel Test and Validation4mo agoHybrid (US (Remote)) · Engineering