an open-source NLP framework that allows you to use LLMs and transformer-based models from Hugging Face, OpenAI and Cohere to interact with your own data.
See official site
a ground-truth-based dynamic benchmark derived from off-the-shelf benchmark mixtures, which evaluates LLMs with a highly capable model ranking (i.e., 0.96 correlation with Chatbot Arena) while running locally and quickly
See official site
a benchmark that evaluates large language models' ability to answer medical questions across multiple languages.
See official site
a meta-benchmark that evaluates how well factuality evaluators assess the outputs of large language models (LLMs).
See official site
focuses on understanding how these models perform in various scenarios and analyzing results from an interpretability perspective.
See official site
Exploring the Intelligence of Large-scale MoE Model.
See official site