Live · CI-reproduced

HumanEval

164 Python function-completion problems. Every score below carries datasetHash, benchmarkInputHash, and a permalink into the harness that produced it.

Benchmark ID [email protected]

Unit pass@1

Methodology humaneval-v1

Last updated Loading…