Google File System
E185682
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
All labels observed (4)
| Label | Occurrences |
|---|---|
| Google File System canonical | 4 |
| The Google File System | 2 |
| Colossus distributed file system | 1 |
| Google File System (GFS) | 1 |
How this entity was disambiguated
This entity first appeared as the object of triple T1647861 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
Target entity: Google File System Context triple: [Hadoop, initiallyInspiredBy, Google File System]
-
A.
Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
-
B.
Google Borg system
The Google Borg system is Google's large-scale internal cluster management and scheduling platform that inspired the design and architecture of Kubernetes.
-
C.
Apache Mesos
Apache Mesos is an open-source cluster manager that abstracts CPU, memory, storage, and other resources away from machines to enable efficient deployment and scaling of distributed applications and frameworks.
-
D.
Google Cloud Dataproc
Google Cloud Dataproc is a managed cloud service for running Apache Hadoop, Spark, and other big data workloads on scalable, automated clusters in Google Cloud.
-
E.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
Target entity: Google File System Target entity description: Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
-
A.
Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
-
B.
Google Borg system
The Google Borg system is Google's large-scale internal cluster management and scheduling platform that inspired the design and architecture of Kubernetes.
-
C.
Apache Mesos
Apache Mesos is an open-source cluster manager that abstracts CPU, memory, storage, and other resources away from machines to enable efficient deployment and scaling of distributed applications and frameworks.
-
D.
Google Cloud Dataproc
Google Cloud Dataproc is a managed cloud service for running Apache Hadoop, Spark, and other big data workloads on scalable, automated clusters in Google Cloud.
-
E.
Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
- F. None of above. chosen
Statements (48)
| Predicate | Object |
|---|---|
| instanceOf |
distributed file system
ⓘ
proprietary software ⓘ |
| alsoKnownAs | GFS ⓘ |
| architectureFeature |
multiple chunkservers
ⓘ
single master server ⓘ |
| chunkSize | 64 MB ⓘ |
| consistencyModel | relaxed consistency ⓘ |
| designedBy | Google engineers ⓘ |
| designedFor |
clusters of commodity hardware
ⓘ
large-scale data-intensive applications ⓘ |
| developer | Google ⓘ |
| ensuresReliabilityBy | replicating chunks across multiple servers ⓘ |
| faultToleranceMechanism |
master state recovery from operation log
ⓘ
replication of chunk data ⓘ |
| handles | frequent component failures ⓘ |
| influenced | design of modern distributed file systems ⓘ |
| inspired |
HDFS
ⓘ
surface form:
Hadoop Distributed File System
|
| license | closed source ⓘ |
| masterDataStructure | in-memory metadata ⓘ |
| masterPersistence | operation log and checkpoints ⓘ |
| optimizedFor |
appending writes
ⓘ
large streaming reads ⓘ |
| paperAbbreviation | SOSP 2003 ⓘ |
| paperAuthors |
Howard Gobioff
ⓘ
Sanjay Ghemawat ⓘ Shun-Tak Leung ⓘ |
| paperPublicationYear | 2003 ⓘ |
| paperPublishedIn |
SOSP
ⓘ
surface form:
ACM Symposium on Operating Systems Principles
|
| paperTitle |
Google File System
self-linksurface differs
ⓘ
surface form:
The Google File System
|
| stores |
access control information
ⓘ
file namespace ⓘ locations of chunk replicas ⓘ mapping from files to chunks ⓘ |
| storesFileDataOn | chunkservers ⓘ |
| storesMetadataOn | master server ⓘ |
| supports |
data replication
ⓘ
fault tolerance ⓘ high throughput ⓘ scalability ⓘ |
| supportsOperation |
record append
ⓘ
snapshot ⓘ |
| targetEnvironment | Google production clusters ⓘ |
| usedFor |
indexing web pages
ⓘ
large-scale data processing at Google ⓘ |
| uses |
heartbeat messages between master and chunkservers
ⓘ
large fixed-size chunks ⓘ leases for mutation control ⓘ version numbers for chunk management ⓘ |
How these facts were elicited
The pipeline generated the facts above by prompting gpt-5.1 with this entity's name + description and the instruction below.
You are a knowledge base construction expert. Given a subject entity and a description of it, return factual statements that you know for the subject as a JSON list of dictionaries(triples), where keys must be "subject", "predicate" and "object". The number of facts may be very high, between 25 to 50 or more, for very popular subjects. For less popular subjects, the number of facts can be very low, like 5 or 10. # Requirements - If you don't know the subject at all, return an empty list. - If the subject is not a named entity, return an empty list. - Include at least one triple where predicate is "instanceOf". - Do not get too wordy. - Separate several objects into multiple triples with one object.
Subject: Google File System Description of subject: Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
Referenced by (8)
Full triples — surface form annotated when it differs from this entity's canonical label.