Software Engineer - Applied AI
RemotePosted 4w ago
About the role
Software Engineer, Applied AI to build the intelligence layer of the Niural platform, focusing on EMMA (AI orchestration system) including agent workflows, retrieval pipelines, and document understanding for payroll, tax, and compliance data.
Responsibilities
- Design, build, and ship production LLM features including agent workflows, tool and function calling, MCP servers, and retrieval-augmented generation pipelines.
- Build retrieval systems over statutory guidance, tax authority publications, contracts, and employee handbooks, owning chunking strategy, embedding selection, hybrid search, reranking, and retrieval quality end to end.
- Build structured extraction pipelines for payroll and compliance documents such as paystubs, statutory filings, and PDFs, including schema enforcement, validation, and repair loops.
- Define and maintain evaluation infrastructure: golden datasets, regression suites in CI, LLM-as-judge calibration, and accuracy and hallucination rate tracked as first-class metrics.
- Optimize latency and cost per task through model routing, prompt and semantic caching, batching, and context window budgeting.
- Implement safety and correctness controls including PII detection and redaction, prompt injection defense, grounded citations, confidence thresholds, and escalation to human reviewers.
- Instrument and monitor AI systems in production using tracing and observability tooling, and debug model behavior with the same rigor applied to application code.
- Collaborate with payroll, tax, and compliance experts to translate regulatory requirements into system behavior, and with product and design to ship user-facing AI features.
- Stay abreast of a fast-moving field and bring back what is actually useful, with a bias toward measurable improvement over novelty.
Qualifications
- 3 plus years of professional software engineering experience, including recent production experience shipping LLM-backed features to real users.
- Strong Python skills and comfort in service-oriented codebases: APIs, queues, background workers, and observability.
- Hands-on experience with retrieval-augmented generation: embedding models, vector stores (pgvector, OpenSearch, Pinecone, or equivalent), hybrid search, reranking, and query rewriting.
- Hands-on experience with agent architectures: tool and function calling, multi-step planning, state and memory, error recovery, and human-in-the-loop checkpoints.
- Experience with structured output: JSON schema enforcement, constrained decoding, validation and repair.
- Experience designing and running LLM evaluations and regression testing, not just eyeballing outputs.
- Working knowledge of prompt and context engineering: versioning, few-shot selection, context budgeting, and prompt caching.
- Experience with LLM observability and tracing tooling such as Langfuse, LangSmith, or OpenTelemetry.
- Sound judgment on where a model belongs and where deterministic code belongs in a regulated, accuracy-critical domain.
- Clear written communication and a habit of documenting technical decisions.
Skills
Required:PythonLLM-backed featuresretrieval-augmented generationstructured output and validationobservability and tracingprompt engineeringcommunication and collaboration
Benefits
- Competitive salary package designed to reward your expertise and contributions.
- Access to continuous learning and career advancement programs.
- Opportunities for mentorship and coaching to help you grow in your career.
- Supportive and collaborative work environment where ideas are valued and teamwork is encouraged.
- Complimentary snacks and lunch provided to keep you energized throughout the shift.
- Latest MacBook Pro and a high-performance monitor will be provided to boost your productivity.
- Partnerships with US universities for fast-track Masters admissions in CS.
- High performers sponsored for L1 and immigrant visas (Green Card) to the US.
Last updated Oct 3, 2026. Interested? Apply on the company site.
About Niural
One HR & Payroll Platform. From First Hire to IPO.
Niural is the future of HR management with centralized control, advanced analytics, and automation for streamlined HR operations worldwide.
HRPayrollPEOEORglobal payrollcontractor managementNiural PayAI
More open roles at Niural
- Marketing Web Developer2d agoMarketing
- Sales Development Representative (SDR)1w agoRemote · Sales
- Manual QA2w agoRemote
- Customer Support Specialist2w agoHybrid (Remote)
- Graphic Designer2w agoHybrid (Remote)