Skip to content

Pull requests: open-compass/VLMEvalKit

New pull request New
52 Open 822 Closed
52 Open 822 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[EASI] merge EASI added benchmarks and models into VLMEvalKit
#1433 opened Feb 5, 2026 by PeterWangyi Loading…
[Feature] update InternVL chat handling
#1432 opened Feb 5, 2026 by PeterWangyi Loading…
[Feature] expand mcq eval judge model support and fix single-image PNG saving
#1431 opened Feb 5, 2026 by PeterWangyi Loading…
[Refactor] Use meta file to decide qwen architecture
#1430 opened Feb 5, 2026 by PeterWangyi Loading…
[Feature] Add a generic prepare_tsv method to VideoBaseDataset class
#1429 opened Feb 5, 2026 by PeterWangyi Loading…
[Fix] 3dsr evaluate func error
#1428 opened Feb 5, 2026 by PeterWangyi Loading…
Support OMTG Benchmark
#1427 opened Feb 4, 2026 by insomniaaac Loading…
1
Fix LLaVA model output issues by using official conversation templates
#1424 opened Feb 2, 2026 by cdllI Loading…
Add LENS dataset support
#1421 opened Jan 30, 2026 by songlier Loading…
bench format update
#1420 opened Jan 29, 2026 by sjarvie Loading…
[Benchmark] Support VLADBench
#1415 opened Jan 24, 2026 by Depth2World Loading…
[Fix] Optimize the evaluation process for OCR-Reasoning
#1413 opened Jan 24, 2026 by shannanyinxiang Loading…
[Benchmark] Support ScienceOlympiad Galaxy10DECaLS VRSBench
#1410 opened Jan 21, 2026 by zhouyujin Loading…
Support asclepius benchmark
#1408 opened Jan 18, 2026 by o0t1ng0o Loading…
Support CoreCognition
#1407 opened Jan 15, 2026 by ZTWHHH Loading…
granite vision fix for transformers 4.57.3
#1404 opened Jan 13, 2026 by alfassy Loading…
[Benchmark] Support Asclepius
#1403 opened Jan 13, 2026 by StevenSU4 Loading…
[Update] Fix warning in Video-MME, unisvg timeout and increase max line width
#1399 opened Jan 9, 2026 by mzr1996 Loading…
[Benchmark] Add Design2Code
#1395 opened Jan 5, 2026 by yanghtr Loading…
[Model] Support CoVT series
#1394 opened Jan 3, 2026 by Wakals Loading…
[Benchmark] Add AV-SpeakerBench
#1393 opened Jan 3, 2026 by plnguyen2908 Loading…
1
[Model]&[Benchmark] Add Moondream3 & DeepSeek-OCR Support; Add Fox OCR Benchmark Support
#1392 opened Jan 2, 2026 by yuxuanfanOrion Loading…
[Benchmark]Add TextHalu-Bench
#1385 opened Dec 28, 2025 by Sammy20207109 Loading…
1
feat: add benchmark groundingme
#1382 opened Dec 25, 2025 by lirang04 Loading…
anno-qwen-pixels
#1381 opened Dec 25, 2025 by The-Martyr Loading…
ProTip! What’s not been updated in a month: updated:<2026-01-04.