HDFS

E187921

Hadoop component distributed file system

HDFS (Hadoop Distributed File System) is a fault-tolerant, distributed file system designed to store and manage large volumes of data across clusters of commodity hardware.

Try in SPARQL Jump to: Surface forms Disambiguation Statements Elicitation Referenced by

All labels observed (4)

Label	Occurrences
HDFS canonical	9
Hadoop Distributed File System	6
DataNode	1
NameNode	1

How this entity was disambiguated

This entity first appeared as the object of triple T1647828 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.

NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07

Target entity: HDFS
Context triple: [Hadoop, hasComponent, HDFS]

A. Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
B. Google File System
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
C. Apache HBase
Apache HBase is a distributed, scalable, NoSQL database designed for real-time read/write access to large datasets, typically running on top of the Hadoop ecosystem.
D. YARN
YARN (Yet Another Resource Negotiator) is Hadoop’s cluster resource management and job scheduling framework that coordinates and allocates system resources for distributed data processing applications.
E. MapReduce
MapReduce is a programming model and processing framework for distributed computation of large data sets across clusters of computers.
F. None of above. chosen
G. Unsure - the case is ambiguous/there is not enough information to decide.

NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07

Target entity: HDFS
Target entity description: HDFS (Hadoop Distributed File System) is a fault-tolerant, distributed file system designed to store and manage large volumes of data across clusters of commodity hardware.

A. Hadoop
Hadoop is an open-source framework that enables distributed storage and parallel processing of large data sets across clusters of commodity hardware.
B. Google File System
Google File System is a distributed file system developed by Google to reliably store and process massive amounts of data across clusters of commodity hardware.
C. Apache HBase
Apache HBase is a distributed, scalable, NoSQL database designed for real-time read/write access to large datasets, typically running on top of the Hadoop ecosystem.
D. YARN
YARN (Yet Another Resource Negotiator) is Hadoop’s cluster resource management and job scheduling framework that coordinates and allocates system resources for distributed data processing applications.
E. MapReduce
MapReduce is a programming model and processing framework for distributed computation of large data sets across clusters of computers.
F. None of above. chosen

Statements (49)

Predicate	Object
instanceOf	Hadoop component ⓘ distributed file system ⓘ
accessibleVia	Java Class Library ⓘ surface form: Java API WebHDFS REST API ⓘ command-line interface ⓘ
architecture	master-slave ⓘ
compatibleWith	YARN ⓘ
designedFor	batch processing workloads ⓘ large-scale data storage ⓘ
developedBy	Apache Software Foundation ⓘ
ensuresReliabilityBy	replicating data blocks across multiple DataNodes ⓘ
fullName	HDFS self-linksurface differs ⓘ surface form: Hadoop Distributed File System
hasComponent	HDFS self-linksurface differs ⓘ surface form: DataNode Apache ZooKeeper ⓘ surface form: JournalNode HDFS self-linksurface differs ⓘ surface form: NameNode Secondary NameNode ⓘ ZKFailoverController ⓘ
hasDefaultBlockSize	128 MB (typical modern default) ⓘ
implements	write-ahead logging for metadata (edit log) ⓘ
introducedIn	early versions of Apache Hadoop (circa mid-2000s) ⓘ
license	Apache License 2.0 ⓘ
notDesignedFor	low-latency random writes ⓘ
optimizedFor	large files ⓘ
partOf	Apache Hadoop ecosystem ⓘ
provides	single namespace for files in a cluster ⓘ
runsOn	clusters of commodity hardware ⓘ
storesBlocksOn	DataNode ⓘ
storesMetadataIn	fsimage and edit log files ⓘ
storesMetadataOn	NameNode ⓘ
supports	fault tolerance ⓘ high throughput data access ⓘ
supportsFeature	append operations ⓘ data replication ⓘ erasure coding ⓘ federation ⓘ high availability ⓘ rack awareness ⓘ snapshots ⓘ streaming data access ⓘ transparent data encryption ⓘ write-once-read-many semantics ⓘ
supportsOS	Linux ⓘ Unix-like systems ⓘ
typicalReplicationFactor	3 ⓘ
usedBy	Apache HBase ⓘ Apache Hive ⓘ Apache Spark ⓘ MapReduce ⓘ
uses	block-based storage ⓘ

How these facts were elicited

Referenced by (17)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hadoop → hasComponent → HDFS ⓘ

Hadoop → storageLayer → HDFS ⓘ

ORC → compatibleWith → HDFS ⓘ

Google Cloud Dataproc → supportsStorage → HDFS ⓘ

Apache Spark → canUseStorage → HDFS ⓘ