Winograd Schema Challenge
E1315983
UNEXPLORED
The Winograd Schema Challenge is an AI benchmark test that evaluates a system’s commonsense reasoning by requiring it to resolve pronoun references in carefully constructed, ambiguous sentences that humans find easy but machines find difficult.
All labels observed (1)
| Label | Occurrences |
|---|---|
| Winograd Schema Challenge canonical | 2 |
How this entity was disambiguated
This entity first appeared as the object of triple T18266795 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: Winograd Schema Challenge Context triple: [Hector Levesque, knownFor, Winograd Schema Challenge]
-
A.
SQuAD 2.0
SQuAD 2.0 is a widely used reading comprehension benchmark dataset that tests machine learning models’ ability to answer questions from passages while also handling unanswerable queries.
-
B.
NETL: A System for Representing and Using Real-World Knowledge
NETL: A System for Representing and Using Real-World Knowledge is an influential early work in artificial intelligence that introduces a network-based framework for encoding and reasoning about commonsense knowledge.
-
C.
“Natural Language Input for a Computer Problem-Solving System”
“Natural Language Input for a Computer Problem-Solving System” is a seminal research paper in artificial intelligence and computational linguistics that explores how computers can understand and process human language to solve problems.
-
D.
Turing test
The Turing test is a benchmark in artificial intelligence that evaluates a machine's ability to exhibit human-like intelligence by determining whether its responses are indistinguishable from those of a human in conversation.
-
E.
“A Question-Answering System for High School Algebra Word Problems”
“A Question-Answering System for High School Algebra Word Problems” is an early AI research project that automatically interprets and solves algebra word problems in natural language, demonstrating machine understanding and reasoning in mathematics.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: Winograd Schema Challenge Target entity description: The Winograd Schema Challenge is an AI benchmark test that evaluates a system’s commonsense reasoning by requiring it to resolve pronoun references in carefully constructed, ambiguous sentences that humans find easy but machines find difficult.
-
A.
SQuAD 2.0
SQuAD 2.0 is a widely used reading comprehension benchmark dataset that tests machine learning models’ ability to answer questions from passages while also handling unanswerable queries.
-
B.
NETL: A System for Representing and Using Real-World Knowledge
NETL: A System for Representing and Using Real-World Knowledge is an influential early work in artificial intelligence that introduces a network-based framework for encoding and reasoning about commonsense knowledge.
-
C.
“Natural Language Input for a Computer Problem-Solving System”
“Natural Language Input for a Computer Problem-Solving System” is a seminal research paper in artificial intelligence and computational linguistics that explores how computers can understand and process human language to solve problems.
-
D.
Turing test
The Turing test is a benchmark in artificial intelligence that evaluates a machine's ability to exhibit human-like intelligence by determining whether its responses are indistinguishable from those of a human in conversation.
-
E.
“A Question-Answering System for High School Algebra Word Problems”
“A Question-Answering System for High School Algebra Word Problems” is an early AI research project that automatically interprets and solves algebra word problems in natural language, demonstrating machine understanding and reasoning in mathematics.
- F. None of above. chosen
Referenced by (2)
Full triples — surface form annotated when it differs from this entity's canonical label.