Skip to content

Pull requests: openai/simple-evals

New pull request New
19 Open 37 Closed
19 Open 37 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Enhance simple-evals for beginner to run
#87 opened Jun 5, 2025 by ECNU3D Loading…
Jules version of beginner friendly README
#81 opened May 20, 2025 by rarhs Loading…
fix(queue): prevent duplicate message send (race condition)
#72 opened May 8, 2025 by Yuu6798 Loading…
feat: add len_var scorer (B-0)
#71 opened May 8, 2025 by Yuu6798 Loading…
fix: add semantic_match scorer to detect drift in math_eval
#69 opened May 4, 2025 by Yuu6798 • Draft
fix regex bug in browsecomp
#67 opened Apr 22, 2025 by tengyaolong2000 Loading…
1
fix: import collision for types
#66 opened Apr 21, 2025 by Ithanil Loading…
Small typo in grader
#57 opened Mar 25, 2025 by chiruu12 Loading…
add aime task
#55 opened Mar 12, 2025 by jason9693 Loading…
Add the F-score metric from the simpleqa paper.
#53 opened Mar 10, 2025 by wbaek Loading…
Initial commit
#45 opened Feb 1, 2025 by osmanjamalfarag Loading…
Grok Sampler
#40 opened Jan 9, 2025 by rolandgvc Loading…
correct string spelling error
#37 opened Dec 27, 2024 by owos Loading…
Fix MMLU answer extraction regex for repeated "Answer: LETTER" pattern
#34 opened Dec 10, 2024 by lucasresck Loading…
Update SimpleQAEval to use direct CSV URL instead of blobfile
#26 opened Oct 31, 2024 by ZhangYiqun018 Loading…
Use correct _pack_message function name
#12 opened May 20, 2024 by andrewmbenton Loading…
1
fix typo
#10 opened May 20, 2024 by dongZheX Loading…
1
Added Chartqa Dataset
#6 opened Apr 14, 2024 by tarunamasa Loading…
1
Remove blobfile dep, load directly from URL
#4 opened Apr 12, 2024 by arkadyark-cohere Loading…
ProTip! Type g i on any issue or pull request to go back to the issue listing page.