Skip to content

Pull requests: open-compass/opencompass

New pull request New
89 Open 1,374 Closed
89 Open 1,374 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Fix] Fix broken Star History chart in README
#2597 opened Aug 14, 2026 by OctoBored Loading…
@tonysy
[Fix] Fix EESE scoring of worded judge replies
#2594 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[Fix] Fix OlympiadBench grading of factored answers
#2593 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[feat]: Add biren supa backend supported
#2591 opened Aug 12, 2026 by frozenleaves Loading…
6 tasks
feat: add Atlas Cloud model config
#2590 opened Aug 10, 2026 by binyangzhu000-sudo Loading…
@bittersweet1999
Fix RJob failure propagation and submission logging
#2587 opened Aug 7, 2026 by JifeiShan Contributor Loading…
@tonysy
[Feat] vlmevalkit support
#2586 opened Aug 6, 2026 by thinszx Loading…
@acylam
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs
#2585 opened Aug 4, 2026 by YL1N Loading…
@liushz
1
Package dataset runtime resources
#2584 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Bound OpenAI REST retries and requests
#2583 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix OpenAI SDK request forwarding
#2582 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix QuALITY hard accuracy calculation
#2581 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Harden CRUXEval output comparison
#2580 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix multi-replica metric aggregation
#2579 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix BABILong 2k config syntax
#2578 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Reject unsupported WildBench evaluation modes
#2577 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix option matching without cushion
#2576 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
[Dataset] Align ARC-AGI-1/2 evaluation with ARC Prize protocol
#2563 opened Jul 21, 2026 by Vicentvankor Loading…
@liushz
Add MedFailBench dataset adapter
#2560 opened Jul 18, 2026 by goktugozkanmd Loading…
@tonysy
3
fix: use last-match in generic LLM judge postprocess (verdict-injection defense)
#2534 opened Jul 14, 2026 by AUTHENSOR Loading…
3 tasks done
@liushz
feat(dataset): add CHHallu-Src v1 — Chinese history hallucination & source-attribution benchmark
#2525 opened Jul 11, 2026 by lizhuojunx86 Loading…
@tonysy
fix(MedCalc_Bench): guard calid-69 ground_truth regex match (AttributeError)
#2523 opened Jul 9, 2026 by WatchTree-19 Loading…
@acylam
fix(evaluator): guard IndexError on truncated judge choice (JudgeEvaluator/RMBEvaluator)
#2522 opened Jul 9, 2026 by WatchTree-19 Loading…
@acylam
Add robust HumanEval postprocess for chat outputs
#2515 opened Jul 8, 2026 by Ding-god Loading…
3 of 6 tasks
1
[Fix] Extract the final answer in GPQA simple-eval predictions
#2496 opened Jun 27, 2026 by Hibbert133 Contributor Loading…
4 of 6 tasks
@tonysy
1
ProTip! Filter pull requests by the default branch with base:main.