10 instances in the dataset with serious errors

[YANGCHEN205]

Hello, we have identified issues in the unit tests for 10 problems within the MHPP dataset. These unit tests appear to be manually designed format errors, such as empty tests and unclosed parentheses. The error IDs are as follows: 79, 98, 120, 135, 139, 150, 159, 171, 175, 181.

In the case of ID 79, the unit test code contains unclosed parentheses, leading to syntax errors. Here's the problematic code snippet with the missing closing parentheses highlighted:

# Original incorrect test cases (missing closing parentheses)
assert rank_task([[1,3],[3,5],[3,2]] == [0,2,1]
assert rank_task([[2,10],[2,6],[3,5],[3,3],[3,1]]) == [1,4,3,2,0]

[1e0ndavid]

Hi,

Thank you very much for taking the time to review the dataset and report these cases.

• The issues you listed have only a minimal impact on model evaluation results.
• I’ve already corrected almost all of the problematic unit tests you noted; for the remaining few, I couldn’t reproduce any obvious errors but will keep an eye on them.
• Your feedback is highly appreciated and helps improve the project.

Feel free to let me know if you spot anything else!