a Swedish language understanding benchmark that evaluates natural language processing (NLP) models on various tasks such as argumentation analysis, semantic similarity, and textual entailment.
See official site
A Python library for validating outputs and retrying failures. Still in alpha, so expect sharp edges and bugs.
See official site
a benchmark that evaluates large language models on a variety of multimodal reasoning tasks, including language, natural and social sciences, physical and social commonsense, temporal reasoning, algebra, and geometry.
See official site
evaluates LLM's ability to call external functions/tools.
See official site
a benchmark evaluating QA methods that operate over a mixture of heterogeneous input sources (KB, text, tables, infoboxes).
See official site
a benchmark for evaluating the performance of large language models (LLMs) in various tasks related to both textual and visual imagination.
See official site