Live leaderboard

HumanEval

164 Python function-completion problems. Verified rows carry datasetHash, benchmarkInputHash, and a permalink into the harness that produced them; reported rows count at the 1.0× lane.