-
Notifications
You must be signed in to change notification settings - Fork 531
Pull requests: open-compass/VLMEvalKit
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
Fix: Molmo Crash - AttributeError: 'NoneType' object has no attribute 'size'
#1297
opened Oct 30, 2025 by
DrishtiShrrrma
Loading…
README: Pin exact transformers for LLaVA-Next to avoid “Got USER: <image>” error
#1294
opened Oct 28, 2025 by
DrishtiShrrrma
Loading…
Official evaluation implementation of HiPhO Benchmark
#1293
opened Oct 28, 2025 by
MarkovChain-why
Loading…
add support for internvideo, videollama, keye and llava-onevision-1.5
WIP
#1244
opened Sep 22, 2025 by
FangXinyu-0913
Loading…
[major] add tsv, xlsx, json fo PRED_FORMAT and csv, json for EVAL_FORMAT
#1172
opened Jul 20, 2025 by
OliverLeeXZ
Loading…
[Model] Add new model provider: AI/ML API
#1093
opened Jun 19, 2025 by
D1m7asis
Loading…
4 tasks done
[Minor] Align MMMU evaluation method with official
Pending
#966
opened Apr 28, 2025 by
FangXinyu-0913
Loading…
[Benchmark] Support Video MCQ with TaskMeAnything-v1-video-random as an example
#359
opened Aug 5, 2024 by
weikaih04
Loading…
[Support] multiple process parallel inference large model on multi-gpu
WIP
#298
opened Jul 19, 2024 by
junming-yang
Loading…
ProTip!
Exclude everything labeled
bug with -label:bug.