AI Tools Hub

A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs.

First LLM Multi-agent framework.

Playground for devs to finetune & deploy LLMs

MLflow: An open-source framework for the end-to-end machine learning lifecycle, helping developers track experiments, evaluate models/prompts, deploy models, and add observability with tracing.

an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.

a benchmark dataset testing AI's ability to reason about visual commonsense through images that defy normal expectations.

a benchmark that evaluates large multimodal models (LMMs) on their ability to perform human-like mathematical reasoning.

a benchmark designed to assess the performance of multimodal web agents on realistic visually grounded tasks.

a large-scale Document Visual Question Answering (VQA) dataset designed for complex document understanding, particularly in financial reports.

a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.

a benchmark platform designed for evaluating large language models (LLMs) on a range of tasks, particularly focusing on their performance in different aspects such as natural language understanding, reasoning, and genera

benchmark designed to evaluate large language models (LLMs) on solving complex, college-level scientific problems from domains like chemistry, physics, and mathematics.