HDFS
E187921
HDFS (Hadoop Distributed File System) is a fault-tolerant, distributed file system designed to store and manage large volumes of data across clusters of commodity hardware.
All labels observed (8)
| Label | Occurrences |
|---|---|
| HDFS canonical | 24 |
| Hadoop Distributed File System | 16 |
| Apache HDFS | 1 |
| Apache Hadoop HDFS | 1 |
| DataNode | 1 |
| HDFS Java API | 1 |
| Hadoop HDFS | 1 |
| NameNode | 1 |
How this entity was disambiguated
This entity first appeared as the object of triple T1647828 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.
NED1
Entity disambiguation (via context triple)
gpt-5-mini-2025-08-07
Target entity: HDFS Context triple: [Hadoop, hasComponent, HDFS]
-
A.
Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
-
B.
Google File System
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
-
C.
Apache HBase
Apache HBase is a distributed, scalable, NoSQL database designed for real-time read/write access to large datasets, typically running on top of the Hadoop ecosystem.
-
D.
YARN
YARN (Yet Another Resource Negotiator) is Hadoop’s cluster resource management and job scheduling framework that coordinates and allocates system resources for distributed data processing applications.
-
E.
MapReduce
MapReduce is a programming model and processing framework for distributed computation of large data sets across clusters of computers.
- F. None of above. chosen
- G. Unsure - the case is ambiguous/there is not enough information to decide.
NED2
Entity disambiguation (via description)
gpt-5-mini-2025-08-07
Target entity: HDFS Target entity description: HDFS (Hadoop Distributed File System) is a fault-tolerant, distributed file system designed to store and manage large volumes of data across clusters of commodity hardware.
-
A.
Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
-
B.
Google File System
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
-
C.
Apache HBase
Apache HBase is a distributed, scalable, NoSQL database designed for real-time read/write access to large datasets, typically running on top of the Hadoop ecosystem.
-
D.
YARN
YARN (Yet Another Resource Negotiator) is Hadoop’s cluster resource management and job scheduling framework that coordinates and allocates system resources for distributed data processing applications.
-
E.
MapReduce
MapReduce is a programming model and processing framework for distributed computation of large data sets across clusters of computers.
- F. None of above. chosen
Statements (49)
| Predicate | Object |
|---|---|
| instanceOf |
Hadoop component
ⓘ
distributed file system ⓘ |
| accessibleVia |
Java API
ⓘ
linked to:
Java Class Library
WebHDFS REST API ⓘ command-line interface ⓘ |
| architecture | master-slave ⓘ |
| compatibleWith | YARN ⓘ |
| designedFor |
batch processing workloads
ⓘ
large-scale data storage ⓘ |
| developedBy | Apache Software Foundation ⓘ |
| ensuresReliabilityBy | replicating data blocks across multiple DataNodes ⓘ |
| fullName |
Hadoop Distributed File System
ⓘ
linked to:
HDFS
|
| hasComponent |
DataNode
ⓘ
linked to:
HDFS
JournalNode ⓘ
linked to:
Apache ZooKeeper
NameNode ⓘ
linked to:
HDFS
Secondary NameNode ⓘ ZKFailoverController ⓘ |
| hasDefaultBlockSize | 128 MB (typical modern default) ⓘ |
| implements | write-ahead logging for metadata (edit log) ⓘ |
| introducedIn | early versions of Apache Hadoop (circa mid-2000s) ⓘ |
| license | Apache License 2.0 ⓘ |
| notDesignedFor | low-latency random writes ⓘ |
| optimizedFor | large files ⓘ |
| partOf | Apache Hadoop ecosystem ⓘ |
| provides | single namespace for files in a cluster ⓘ |
| runsOn | clusters of commodity hardware ⓘ |
| storesBlocksOn | DataNode ⓘ |
| storesMetadataIn | fsimage and edit log files ⓘ |
| storesMetadataOn | NameNode ⓘ |
| supports |
fault tolerance
ⓘ
high throughput data access ⓘ |
| supportsFeature |
append operations
ⓘ
data replication ⓘ erasure coding ⓘ federation ⓘ high availability ⓘ rack awareness ⓘ snapshots ⓘ streaming data access ⓘ transparent data encryption ⓘ write-once-read-many semantics ⓘ |
| supportsOS |
Linux
ⓘ
Unix-like systems ⓘ |
| typicalReplicationFactor | 3 ⓘ |
| usedBy |
Apache HBase
ⓘ
Apache Hive ⓘ Apache Spark ⓘ MapReduce ⓘ |
| uses | block-based storage ⓘ |
How these facts were elicited
The pipeline generated the facts above by prompting gpt-5.1 with this entity's name + description and the instruction below.
Instruction
You are a knowledge base construction expert. Given a subject entity and a description of it, return factual statements that you know for the subject as a JSON list of dictionaries(triples), where keys must be "subject", "predicate" and "object". The number of facts may be very high, between 25 to 50 or more, for very popular subjects. For less popular subjects, the number of facts can be very low, like 5 or 10. # Requirements - If you don't know the subject at all, return an empty list. - If the subject is not a named entity, return an empty list. - Include at least one triple where predicate is "instanceOf". - Do not get too wordy. - Separate several objects into multiple triples with one object.
Input
Subject: HDFS Description of subject: HDFS (Hadoop Distributed File System) is a fault-tolerant, distributed file system designed to store and manage large volumes of data across clusters of commodity hardware.
Referenced by (46)
Full triples — surface form annotated when it differs from this entity's canonical label.
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
subject linked to:
Apache ORC project
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS
linked to: HDFS