Applied AI Data Analyst
Hybrid (New York, NY)$180k - $230kFull-timePosted 1mo ago
About the role
Applied AI Data Analyst role at Confido, NY-based, full-time, in-person with relocation support. You will bridge unstructured financial/operational data to the core R&D team, own evaluation platforms for agentic workflows forecasting, and enhance customer-facing insights to inform mission-critical decisions. Opportunities to advance to senior data science and AI/ML engineering within the Applied AI Research department.
Responsibilities
- Algorithm & LLM Evaluation: Analyze edge cases, model predictions, hallucination rates, and extraction accuracy for LLM-driven document processing systems and agentic workflows.
- Root Cause Analysis: Investigate complex datasets to understand why extractions or time-series models succeed or fail.
- Golden Dataset Curation: Define, curate, and maintain gold-standard evaluation datasets for automated backtesting of AI agents and demand forecasting models.
- Performance Monitoring & Evals: Build dashboards, data transformations, and evaluation harnesses to monitor system health, model drift, and AI performance metrics across release cycles.
- Cross-Functional Collaboration: Partner with applied AI engineers, product managers, and business operations managers to turn real-world problem definitions into quantitative product insights.
Qualifications
- Education: Graduate degree (M.S. or Ph.D.) in Computer Science, Data Science, Statistics, Mathematics, Physics, or related STEM field.
- Experience: 2–4 years in a quantitative data analyst or AI evaluation role, collaborating with AI/ML R&D teams.
- Programming & Agentic AI: Proficiency in Python and hands-on work with AI/ML models.
- Data Stack: Strong SQL and enterprise data infrastructure experience (PostgreSQL, Snowflake, dbt, AWS).
- Analytical Mindset: Ability to translate noisy, unstructured document data into rigorous evaluation insights for engineers.
Skills
Required:PythonSQLPostgreSQLSnowflakedbtLanguage Model EvaluationData Visualization & Dashboards
Benefits
- Equity — own a meaningful piece of the company.
- Fully paid health coverage through Aetna — 100% employee premiums.
- Top-tier dental and vision coverage through Guardian.
- Carrot Fertility Pro — fertility and family-forming support.
- 12 weeks of paid parental leave.
- Unlimited PTO with quarterly long weekends.
- 401(k) through Vestwell.
- Paid relocation support to NYC.
- Fully equipped workspace from day one — laptop, monitor, keyboard, and $200 setup stipend.
- Team perks — catered Friday lunches, team dinners, unlimited coffee and snacks.
Last updated Oct 7, 2026. Interested? Apply on the company site.
About Confido
AI-enabled financial automation and intelligence for CPG Brands
Confido is a next-generation financial automation and intelligence platform that helps fast-growing CPG brands operate and scale more efficiently.
fintechsaasanalyticsai
More open roles at Confido
- Applied AI/ML Engineer1mo agoHybrid (New York, NY) · Engineering
- Senior Applied AI/ML Engineer1mo agoNew York, NY
- Finance & Strategy Manager1mo agoNew York, NY
- Senior Sales Recruiter1mo agoNew York City, NY · Sales
- Data Scientist1mo agoHybrid (New York, NY)