Building the open source standard for evaluating LLM Applications

The fragmented and proprietary evaluation tools today are leading to significant inefficiencies and confusion among developers. The world needs a standard everyone can rely on and that is why we are building Ragas as the open-source standard. We have 4k stars on GitHub, 1.3k members in our discord community, and over 80+ external contributors. We also have partnerships with key AI companies like Langchain, Llamaindex, Arize, Weaviate and more to help create a standard. We already process 5 million evaluations monthly for engineers from companies like AWS, Microsoft, Databricks, and Moody’s and it is growing at 70% month over month. We are building LLM application testing and evaluation infrastructure for Enterprises.

developer-toolsgenerative-aiopen-sourceai

Total Open and Closed Positions

Total open positions, and positions newly closed since the previous update

Department Headcount Over Time

Open positions per department · top 6 at any point in the window

Newly Opened and Closed Positions

Position Churn Rate

Positions closed within 14 days of opening · a high rate suggests posting instability — duplicates, pulled listings, or roles filled through internal or off-market channels

Time-to-Fill Distribution

Days from open to close · closed positions only

Salary Trend Over Time

Monthly median base salary · USD · annualized · p25/p75 dashed

Salary Range by Department

Employment Type

Technical vs. Non-technical

Open positions · by department

Top Roles by Department

Seniority Mix

Derived from job title keywords

Equity Range by Department

Top Skills

Top Tech Stacks

Skills Trend

Change in share of postings · recent 3 months vs. prior 3 months

Tech Stack Evolution

Positions opened per month · top 5 technologies