One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks
Evidence-aware reference methods for text and speech affect components
Reproducible multimodal evaluation for controlled generative-image experiments, VLM assessment, provenance, and structured reporting.
HackerRank multimodal claim-evidence evaluation starter with reusable Agent Skills for project bootstrap and local multimodal testing.
VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation. Calibrated prediction intervals for VLM-as-a-Judge using only score-token logprobs.
Add a description, image, and links to the multimodal-evaluation topic page so that developers can more easily learn about it.
To associate your repository with the multimodal-evaluation topic, visit your repo's landing page and select "manage topics."