Dataflow worker

E427704

Google Cloud Dataflow component compute instance type

A Dataflow worker is a compute instance in Google Cloud Dataflow that executes the parallel processing tasks of a data pipeline.

Try in SPARQL Jump to: Surface forms Disambiguation Statements Elicitation Referenced by

All labels observed (2)

Label	Occurrences
Dataflow SDK worker harness	1
Dataflow worker canonical	1

How this entity was disambiguated

This entity first appeared as the object of triple T4279660 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.

NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07

Target entity: Dataflow worker
Context triple: [Google Cloud Dataflow, resourceType, Dataflow worker]

A. Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
B. Web workers
Web workers are a web platform feature that enable running JavaScript in background threads separate from the main UI thread to perform computationally intensive or asynchronous tasks without blocking user interactions.
C. NVIDIA AI Workflows
NVIDIA AI Workflows are pre-built, end-to-end AI pipelines from NVIDIA that streamline the development, deployment, and scaling of AI applications across common enterprise use cases.
D. Workflow Builder
Workflow Builder is Slack’s no-code tool that lets users automate routine tasks and create custom workflows directly within their Slack workspace.
E. Management and the Worker
Management and the Worker is a landmark 1939 book by Elton Mayo and colleagues that analyzes the Hawthorne studies and helped establish the human relations movement in industrial and organizational psychology.
F. None of above. chosen
G. Unsure - the case is ambiguous/there is not enough information to decide.

NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07

Target entity: Dataflow worker
Target entity description: A Dataflow worker is a compute instance in Google Cloud Dataflow that executes the parallel processing tasks of a data pipeline.

A. Google Cloud Dataflow
Google Cloud Dataflow is a fully managed service for developing and executing batch and streaming data processing pipelines, based on Apache Beam, within the Google Cloud ecosystem.
B. Web workers
Web workers are a web platform feature that enable running JavaScript in background threads separate from the main UI thread to perform computationally intensive or asynchronous tasks without blocking user interactions.
C. NVIDIA AI Workflows
NVIDIA AI Workflows are pre-built, end-to-end AI pipelines from NVIDIA that streamline the development, deployment, and scaling of AI applications across common enterprise use cases.
D. Workflow Builder
Workflow Builder is Slack’s no-code tool that lets users automate routine tasks and create custom workflows directly within their Slack workspace.
E. Pipeline
Pipeline is a scikit-learn utility that chains multiple data processing and modeling steps into a single composite estimator for streamlined machine learning workflows.
F. None of above. chosen

Statements (49)

Predicate	Object
instanceOf	Google Cloud Dataflow component ⓘ compute instance type ⓘ
canBe	primary worker ⓘ secondary worker ⓘ
canUse	custom machine types ⓘ preemptible VMs ⓘ
communicatesWith	Dataflow service backend ⓘ other Dataflow workers ⓘ
configuredBy	Dataflow job configuration ⓘ number of workers setting ⓘ worker machine type setting ⓘ
createdBy	Dataflow job submission ⓘ
environment	Google Cloud project ⓘ
executes	Apache Beam transforms ⓘ data pipeline stages ⓘ parallel processing tasks ⓘ
hasProperty	disk size ⓘ machine type ⓘ memory size ⓘ number of vCPUs ⓘ zone ⓘ
hasRole	executing pipeline steps ⓘ
logsTo	Cloud Logging ⓘ
managedBy	Dataflow service ⓘ linked to: Google Cloud Dataflow
monitoredBy	Cloud Monitoring ⓘ
partOf	Google Cloud Dataflow ⓘ
performs	aggregation operations ⓘ data shuffling ⓘ user-defined functions ⓘ windowing operations ⓘ
providedBy	Google Cloud ⓘ Google Cloud Dataflow service ⓘ linked to: Google Cloud Dataflow
readsFrom	BigQuery ⓘ linked to: Google BigQuery Cloud Storage ⓘ linked to: Google Cloud Storage Pub/Sub ⓘ linked to: Google Cloud Pub/Sub data sources ⓘ
runsOn	Google Compute Engine virtual machine ⓘ linked to: Google Compute Engine
securedBy	IAM permissions ⓘ service account ⓘ
supports	autoscaling of worker count ⓘ worker harness for Apache Beam ⓘ
terminatedBy	Dataflow job completion ⓘ
usedFor	batch data processing ⓘ streaming data processing ⓘ
uses	Dataflow SDK worker harness ⓘ linked to: Dataflow worker
writesTo	BigQuery ⓘ linked to: Google BigQuery Cloud Storage ⓘ linked to: Google Cloud Storage Pub/Sub ⓘ linked to: Google Cloud Pub/Sub data sinks ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Google Cloud Dataflow → resourceType → Dataflow worker ⓘ

Dataflow worker → uses → Dataflow SDK worker harness ⓘ

linked to: Dataflow worker

All labels observed (2)

How this entity was disambiguated Show

Statements (49)

How these facts were elicited Show

Referenced by (2)

How this entity was disambiguated

How these facts were elicited