Distinguished Agent Engineer
Fastino Labs· Engineering
Hybrid (San Francisco Bay Area)Full-timePosted 1w ago
About the role
Senior IC engineering role to set technical direction for agentic systems on Fastino models, contribute core code, and raise the bar for the team.
Responsibilities
- Design and own the architecture for agentic systems built on Fastino's small, fast models: planning, tool use, memory, and multi-agent orchestration.
- Figure out where specialized models beat frontier LLMs inside agent loops, and prove it with benchmarks and real customer workloads.
- Build the evals, telemetry, and feedback loops that tell us when agents are getting better (or worse) and why.
- Partner with research to turn new model architectures into agent capabilities, and shape what research works on next.
- Make agents fast and reliable at scale: low latency inference, high concurrency serving, graceful failure handling.
- Drive data and fine-tuning strategy for agent specific tasks like tool calling, extraction, and routing.
Qualifications
- 5+ years of software engineering experience, with 3+ years building with LLMs or ML in production.
- A track record of shipping agentic systems that real users rely on, and the scars to prove it.
- Deep experience across the stack: prompt and context engineering, tool and API design, vector DBs, Kubernetes, and inference serving.
- Strong understanding of model behavior: fine-tuning, evals, failure modes, and latency/cost tradeoffs.
- Experience setting technical direction across teams, not just within one project.
- You write clearly and make complicated systems feel simple.
- Bonus: experience building high concurrency microservices for agent workloads.
- Bonus: familiarity with GLiNER or other information extraction architectures.
- Bonus: open source contributions, papers, or talks on agents or LLM systems.
Skills
Required:Software engineeringAgentic systemsPrompt and context engineeringTool and API designVector databasesKubernetesInference servingModel fine-tuningEvaluation and latency/cost tradeoffsCommunication
Nice to have:High concurrency microservicesGLiNER or information extraction architecturesOpen source contributions/papers/talks on agents or LLM systems
Last updated Oct 20, 2026. Interested? Apply on the company site.
About Fastino Labs
Building the future of small language models
Move beyond general-purpose LLMs. Production-ready, fine-tuned SLMs for Agentic AI.
PioneerGLiNERsmall language modelsAgentic AIAPIsstructured data extractionclassificationreasoning
More open roles at Fastino Labs
- Forward Deployed Engineer1w agoHybrid (San Francisco Bay Area) · Engineering
- Account Executive1w agoSan Francisco Bay Area · Sales