Statements (43)
| Predicate | Object |
|---|---|
| gptkbp:instanceOf |
web crawler
|
| gptkbp:alsoKnownAs |
gptkb:Googlebot
|
| gptkbp:block |
robots.txt
|
| gptkbp:canBe |
user agent string
|
| gptkbp:category |
search engine crawler
|
| gptkbp:documentation |
https://developers.google.com/search/docs/crawling-indexing/overview-google-crawlers
|
| gptkbp:firstReleased |
1998
|
| gptkbp:followsProtocol |
robots.txt
|
| gptkbp:frequency |
continuous
|
| gptkbp:hasUserAgent |
gptkb:Googlebot
APIs-Google AdsBot-Google Googlebot-Image Googlebot-Mobile Googlebot-News Googlebot-Video |
| https://www.w3.org/2000/01/rdf-schema#label |
Google's web crawlers
|
| gptkbp:includes |
gptkb:Googlebot
APIs-Google AdsBot-Google Googlebot-Image Googlebot-Mobile Googlebot-News Googlebot-Video |
| gptkbp:language |
gptkb:Java
gptkb:Python gptkb:C++ |
| gptkbp:notableCollection |
images
news articles metadata videos web content links |
| gptkbp:operatedBy |
gptkb:Google
|
| gptkbp:partOf |
gptkb:Google_Search_infrastructure
|
| gptkbp:respectedBy |
robots.txt
canonical tags nofollow directive noindex directive |
| gptkbp:usedFor |
gptkb:search_engine_optimization
indexing web pages |
| gptkbp:bfsParent |
gptkb:Safe_Browsing
|
| gptkbp:bfsLayer |
7
|