Statements (23)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
web crawler
|
| gptkbp:citation |
Heydon, Allan, et al. 'Mercator: A scalable, extensible Web crawler.' World Wide Web 2.4 (1999): 219-229.
|
| gptkbp:designedFor |
large-scale web crawling
|
| gptkbp:developedBy |
gptkb:Compaq_Systems_Research_Center
|
| gptkbp:developer |
gptkb:Marc_Najork
gptkb:Monika_Henzinger Allan Heydon Janet Wiener Kenneth J. McCurley |
| https://www.w3.org/2000/01/rdf-schema#label |
Mercator web crawler
|
| gptkbp:influenced |
gptkb:IBM_WebFountain
|
| gptkbp:notableFor |
scalability
flexibility |
| gptkbp:releaseYear |
1997
|
| gptkbp:supports |
customizable modules
URL filtering distributed crawling content parsing politeness policies |
| gptkbp:usedBy |
gptkb:AltaVista
|
| gptkbp:writtenBy |
gptkb:Java
|
| gptkbp:bfsParent |
gptkb:Rolf_Najork
|
| gptkbp:bfsLayer |
7
|