AI Tools Hub

a comprehensive benchmarking platform designed to evaluate large models' mathematical abilities across 20 fields and nearly 30,000 math problems.

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.

a benchmark designed to evaluate large language models in the legal domain.

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.

a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).

CompassRank is dedicated to exploring the most advanced language and visual models, offering a comprehensive, objective, and neutral evaluation reference for the industry and research.

evaluates LLM's ability to call external functions/tools.

A pioneering benchmark specifically designed to assess honesty in LLMs comprehensively.

An Automatic Evaluator for Instruction-following Language Models using Nous benchmark suite.