Machine Learning Engineer - Inference Maintainer & Developer Experience
About the role
Machine Learning Engineer focused on maintaining and improving Roboflow's inference engine and developer experience, with emphasis on building an agentic-driven contribution and release pipeline, expanding test coverage, and enabling adoption of new models in the inference project.
Responsibilities
- - Build and maintain inference, Roboflow's flagship CV inference engine, ensuring health and high-quality contributions as volume scales.
- - Build an agentic-driven contribution pipeline with automated/semi-automated review, triage, and CI/CD to enable high-volume agent-generated PRs and shift from weekly to daily releases.
- - Design and grow a world-grounded test suite validating real build health across targets (standalone and on-platform), aiming for nightly end-to-end runs.
- - Define and enforce review standards and rules for agents and contributors, embedding judgment into the system.
- - Streamline adding new models to inference, accelerating bring-up of latest CV/ML models for users.
- - Teach and enable internal teams and customers, helping Field Engineers and Support to self-serve and extract maximum value.
- - Bridge core engineering and clients by translating capabilities into docs, demos, stories, and launches.
- - Contribute to and grow the broader open source community around the project.
Qualifications
- - 5+ years of hands-on experience building and operating production-grade ML systems, preferably with large-scale deployment of modern AI models.
- - A strong CV/ML foundation: understanding of inference, deployment across environments, and real-world use.
- - Stellar agentic skills: experience building with AI coding agents to automate engineering processes (review, triage, testing, CI).
- - Strong CS and systems background with ability to tackle complex programming, architecture, and reliability challenges.
- - Hands-on experience with CI/CD, release engineering, and test infrastructure.
- - Practical expertise with core ML technologies (e.g., PyTorch, TensorFlow, ONNX, TensorRT, vLLM or similar).
- - Strong image/video processing proficiency (OpenCV, DeepStream, Pillow, PyAV; hardware-accelerated decoding; video streaming knowledge a plus).
- - Excellent communication and soft skills; comfortable being a public-facing voice for a project.
- - Open source maintenance experience is a strong plus.
- - Willingness to level-up with AI agents.
Skills
Benefits
- - $4000/yr Travel Stipend
- - $350/mo Productivity stipend
- - $350/mo AI Tools stipend
- - Health insurance costs covered for you and your partner/family (100%)
- - $150/mo team lunch stipend
- - Remote first / flexible schedule
- - Unlimited PTO with a minimum of 2 weeks annually
- - 12 weeks parental leave
- - Equity in the company

About Roboflow
🖼️ Give your software the sense of sight.
Roboflow enables developers to make the world programmable. Use our tools to build better datasets (collect image, video / annotate), models (foundation and fine tuned small models), and deployments (self hosted, edge, APIs, SDKs) for computer vision. Over 250k developers, including those from over half the Fortune 100, build with our open source and hosted tools. Build with us: https://app.roboflow.com Hack with us: https://roboflow.slab.com/public/posts/roboflow-hackathons-external-u478m1iz Work with us: roboflow.com/careers
More open roles at Roboflow
- Research Scientist1w agoOperations
- Sales Development Leader1w agoHybrid (New York, NY)
- Commercial Sales Leader1w agoHybrid (New York, NY / Remote (US)) · Sales
- Infrastructure Engineer1w agoHybrid (Remote (US) / New York (NY) / San Francisco (SF)) · Engineering
- People and Office Coordinator1w agoNew York, NY · People
