evalution

Evaluation tools for Retrieval-augmented Generation (RAG) methods.

Home of the SanityHarness Leaderboard website.

Evidence-grounded multi-source knowledge graph construction with duplicate-resistant identity resolution, provenance, validation, and reproducible benchmarks.

The official repository for the dataset FactualBench, which is introduced in paper "Exploring the Generalizability of Factual Hallucination Mitigation via Enhancing Precise Knowledge Utilization".

A Python toolkit for the robust evaluation and analysis of seizure detection models.

A Flask-Celery integration template for distributed task processing with progress tracking and use MMMLU to evaluation example.

An AI-powered application that provides different reviews of users' playlists across various platforms.

Multi-class classification of news articles using NLP techniques, TF-IDF, and Naive Bayes

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

R package for multiplicity-adjusted bootstrap tilting confidence limits for prediction performance after model selection

Production-oriented RAG pipeline for internal documents using hybrid dense + BM25 search, RRF fusion, cross-encoder reranking, confidence gating, and verified citations. Includes FastAPI APIs, Qdrant storage, evaluation benchmarks, testing, Docker deployment, and a monitoring dashboard.

Automated fish species classification using deep learning (CNN + transfer learning). Includes model training, evaluation metrics, and a Streamlit app for real-time predictions.