NLP tool for wide-range model reliability evaluations
-
Updated
Jun 18, 2023 - Python
NLP tool for wide-range model reliability evaluations
[ICML 2024] Code for the paper "MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts"
Crash-safe distributed job execution with fencing tokens, lease recovery and deterministic failure validation.
Evaluation framework for AI coding agents: corrected reliability@k metric, security-adjusted scoring, and SWE-bench verified integration
Add a description, image, and links to the reliability-benchmarking topic page so that developers can more easily learn about it.
To associate your repository with the reliability-benchmarking topic, visit your repo's landing page and select "manage topics."