Search results

Please support evaluation of pass@N asap

Status: Open.

#11 In SparksofAGI/MHPP;

· Imbernoulli opened on Aug 30, 2025

Release MHPP dataset on Hugging Face

Status: Open.

#10 In SparksofAGI/MHPP;

· NielsRogge opened on Aug 19, 2025

10 instances in the dataset with serious errors

Status: Open.

#9 In SparksofAGI/MHPP;

· YANGCHEN205 opened on Jun 17, 2025

Request for pass@k Evaluation Support on MHPP Benchmark

Status: Open.

#8 In SparksofAGI/MHPP;

· hanker-zhu opened on May 19, 2025

Evaluation Server Down

Status: Open.

#7 In SparksofAGI/MHPP;

· shenz2-2000 opened on Feb 11, 2025

💡 [REQUEST] - <OpenAI O1-2024-12-17>

Status: Open.

#6 In SparksofAGI/MHPP;

· Belzedar94 opened on Dec 19, 2024

🤗 [REQUEST] - OpenAI new O1 models (O1-preview and O1-mini)

Status: Open.

#5 In SparksofAGI/MHPP;

· Belzedar94 opened on Sep 14, 2024

💡 [REQUEST] - gemini-1.5-pro and gemini-1.5-flash

Status: Open.

#2 In SparksofAGI/MHPP;

· rizkidotme opened on Jul 13, 2024

No groundtruth code and test unit cases

Status: Open.

#1 In SparksofAGI/MHPP;

· sinsauzero opened on May 31, 2024