AI Tools Hub

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.

a large-scale Document Visual Question Answering (VQA) dataset designed for complex document understanding, particularly in financial reports.

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.

a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and genera

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.

a biomedical question-answering benchmark designed for answering research-related questions using PubMed abstracts.

a multimodal question-answering benchmark designed to evaluate AI models' cognitive ability to understand human beliefs and goals.

a benchmark that evaluates large language models' ability to answer medical questions across multiple languages.

a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking (i.e., 0.96 correlation with Chatbot Arena) while running locally and quickly