AI Tools Hub

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

a benchmark that evaluates large language models' ability to answer medical questions across multiple languages.

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking (i.e., 0.96 correlation with Chatbot Arena) while running locally and quickly

a comprehensive benchmarking platform designed to evaluate large models' mathematical abilities across 20 fields and nearly 30,000 math problems.

a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.

focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.

a benchmark designed to evaluate large language models in the legal domain.

a benchmark designed to evaluate large language models (LLMs) specifically in their ability to answer real-world coding-related questions.

a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).

a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.

a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).