|
gptkbp:instanceOf
|
gptkb:dataset
|
|
gptkbp:assesses
|
pass@k
|
|
gptkbp:category
|
programming problems
AI benchmark
|
|
gptkbp:citation
|
2021
|
|
gptkbp:contains
|
solutions
test cases
problems for code generation
|
|
gptkbp:creator
|
gptkb:Dawn_Song
gptkb:Jacob_Steinhardt
gptkb:Collin_Burns
gptkb:Andrew_Critch
Dan Hendrycks
Jerry Li
Steven Basart
|
|
gptkbp:difficulty
|
introductory to interview-level
|
|
gptkbp:domain
|
computer science
|
|
gptkbp:focus
|
problem solving
code generation
|
|
gptkbp:fullName
|
Automated Programming Progress Standard
|
|
gptkbp:hostedBy
|
gptkb:GitHub
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
APPS
|
|
gptkbp:language
|
gptkb:Python
|
|
gptkbp:license
|
gptkb:MIT_License
|
|
gptkbp:notablePublication
|
Measuring Coding Challenge Competence With APPS
https://arxiv.org/abs/2105.09938
|
|
gptkbp:numberOfRooms
|
10,000+
|
|
gptkbp:relatedTo
|
gptkb:Codeforces
gptkb:LeetCode
gptkb:HumanEval
|
|
gptkbp:releaseYear
|
2021
|
|
gptkbp:usedBy
|
gptkb:Google
gptkb:OpenAI
AI researchers
|
|
gptkbp:usedFor
|
benchmarking AI code generation
|
|
gptkbp:bfsParent
|
gptkb:Digital_Turbine
gptkb:Act_to_Prevent_Pollution_from_Ships
|
|
gptkbp:bfsLayer
|
7
|