Senior AI / ML Engineer
Artificial Analysis· Engineering
Melbourne (On-site)Full-timePosted 1mo ago
About the role
Senior AI/ML Engineer to lead projects in AI benchmarking and analysis, build core parts of the software stack, and work closely with founders in a fast-growing AI benchmarking startup.
Responsibilities
- Lead the development and optimization of core benchmarking stack, focusing on data-intensive backend systems and APIs, and drive projects from concept to shipped
- Design and implement robust Python solutions for benchmarking, model evaluation and data analysis
- Design and implement user interfaces and data visualizations that distill complex AI benchmarking data into intuitive, interactive experiences for thousands of daily users
- Conduct custom analyses for enterprise customers, providing actionable insights to inform their AI strategies
- Contribute to the evolution of benchmarking methodologies, including development of evaluation methodology for emerging modalities and capabilities
- Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry
Qualifications
- 3+ years of professional software engineering experience
- Passion for AI and eagerness to work at the forefront of technological innovation
- Proficiency with relevant Python libraries for data analysis (e.g. pandas) and key AI APIs (e.g. OpenAI)
- Familiarity with cloud infrastructure, orchestration and monitoring tools
- Experience with visualizing and presenting data
- Strong problem-solving skills and ability to distill complex concepts into actionable insights in the face of uncertainty
- Excellent communication and collaboration skills
- Proven ability to lead projects independently in a fast-paced environment
- Bachelor’s or Master’s in Computer Science, Engineering, or related field (e.g. Physics)
- Preferred but not essential: Experience with AI/ML frameworks (e.g. PyTorch)
- Preferred but not essential: Creation of analytical reports
Skills
Required:PythonData analysis / pandasAI APIsCloud infrastructureData visualizationCommunication / collaborationProject leadershipEducational background
Benefits
- Competitive compensation including equity
Last updated Oct 1, 2026. Interested? Apply on the company site.
About Artificial Analysis
Independent analysis of AI
AI ModelAPI ProvidersAnalysisBenchmarkingIndependenceEvaluationIntelligence IndexLeaderboards
More open roles at Artificial Analysis
- Member of Technical Staff (Applied AI Research)1mo agoSan Francisco (On-site) · Technical Staff (incl. Product)
- Member of Technical Staff (Commercial) - Strategy Consulting track1mo agoSan Francisco (On-site) · Technical Staff (incl. Product)
- Forward Deployed Engineer - Language Models1mo agoSan Francisco (On-site), Melbourne (On-site) · Platform & Forward Deployed Engineering
- Senior AI / ML Engineer1mo agoSan Francisco (On-site) · Engineering
- Product Manager (Media Generation - Image & Video)1mo agoSan Francisco (On-site) · Technical Staff (incl. Product)