Member of Technical Staff, Forward Deployed Engineer
San FranciscoFull-timePosted 2w ago
About the role
Inferact is growing vLLM as the world’s AI inference engine and accelerates AI progress by making inference cheaper and faster. The Forward Deployed Engineer will deploy, integrate, debug, and optimize vLLM-powered inference systems inside real customer environments, working across cloud, Kubernetes, GPU, networking, and model-serving environments to drive customer time-to-value and inform product evolution.
Responsibilities
- Work directly with customers to deploy, integrate, debug, and optimize vLLM-powered inference systems across cloud, Kubernetes, GPU, networking, and model-serving environments.
- Move from architecture discussions to implementation in production settings.
- Own difficult production problems end-to-end and collaborate with core product and engineering teams to translate field learnings into reusable product capabilities.
Qualifications
- Bachelor's degree or equivalent experience in computer science, engineering, systems, machine learning, or similar.
- Strong software engineering ability in Python, Go, TypeScript, or similar, with experience building production-quality integrations, tooling, services, automation, or prototypes.
- Hands-on experience deploying or operating ML systems, model serving, AI infrastructure, cloud platforms, Kubernetes, or high-scale backend systems in production.
- Ability to work directly with sophisticated customer engineering teams, understand ambiguous technical environments, and drive implementations and debugging to resolution.
- Strong systems debugging skills across application, runtime, infrastructure, networking, identity, storage, observability, and distributed-system boundaries.
- Ability to reason about latency, throughput, batching, model/runtime compatibility, scaling, reliability, and cost tradeoffs in production inference environments.
- High ownership and strong technical communication, with good judgment to distinguish one-off customer work from reusable product opportunities.
Skills
Required:PythonGoTypeScriptProduction ML systems deploymentSystems debuggingCustomer-facing engineering
Benefits
- generous health, dental, and vision benefits
- 401(k) company match
Last updated Oct 11, 2026. Interested? Apply on the company site.
About Inferact
Inferact is a startup founded by creators and core maintainers of vLLM, the most popular open-source LLM inference engine.
AIbessemer-ai-infrastructure-2026frontier hardwareinferenceinference engineinference-inflection-pointopen sourcevLLM
More open roles at Inferact
- Engineering Manager1w agoSan Francisco · Research & Engineering
- Enterprise Partnerships Manager2w agoSan Francisco · GTM
- GTM Engineer2w agoSan Francisco · GTM
- Strategic Finance Lead2w agoSan Francisco · Finance
- Member of Technical Staff, Vulnerability Management2w agoSan Francisco · Research & Engineering