Heritrix web crawler
E1339943
UNEXPLORED
Heritrix web crawler is an open-source, extensible web-scale crawling engine designed primarily for web archiving by institutions like the Internet Archive.
All labels observed (1)
| Label | Occurrences |
|---|---|
| Heritrix web crawler canonical | 1 |
How this entity was disambiguated
This entity first appeared as the object of triple T18724923 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: Heritrix web crawler Context triple: [WARC, associatedSoftware, Heritrix web crawler]
-
A.
Common Crawl
Common Crawl is a massive, publicly available web archive that regularly crawls and stores petabytes of web page data for use in research and large-scale data analysis.
-
B.
Internet Archive
The Internet Archive is a nonprofit digital library that preserves and provides free access to vast collections of websites, books, audio, video, and other cultural artifacts online.
-
C.
Stanford Digital Library Project
The Stanford Digital Library Project was a pioneering research initiative at Stanford University in the 1990s that explored advanced technologies for organizing, searching, and accessing large-scale digital information, and it played a key role in the origins of Google.
-
D.
Jetpack Search
Jetpack Search is a powerful WordPress search enhancement tool that provides fast, relevant, and customizable search results for websites using the Jetpack plugin.
-
E.
Archie search engine
Archie search engine was one of the earliest Internet search tools, designed to index and help users locate files on public FTP servers before the World Wide Web became widespread.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: Heritrix web crawler Target entity description: Heritrix web crawler is an open-source, extensible web-scale crawling engine designed primarily for web archiving by institutions like the Internet Archive.
-
A.
Common Crawl
Common Crawl is a massive, publicly available web archive that regularly crawls and stores petabytes of web page data for use in research and large-scale data analysis.
-
B.
Internet Archive
The Internet Archive is a nonprofit digital library that preserves and provides free access to vast collections of websites, books, audio, video, and other cultural artifacts online.
-
C.
Stanford Digital Library Project
The Stanford Digital Library Project was a pioneering research initiative at Stanford University in the 1990s that explored advanced technologies for organizing, searching, and accessing large-scale digital information, and it played a key role in the origins of Google.
-
D.
Jetpack Search
Jetpack Search is a powerful WordPress search enhancement tool that provides fast, relevant, and customizable search results for websites using the Jetpack plugin.
-
E.
Archie search engine
Archie search engine was one of the earliest Internet search tools, designed to index and help users locate files on public FTP servers before the World Wide Web became widespread.
- F. None of above. chosen
Referenced by (1)
Full triples — surface form annotated when it differs from this entity's canonical label.