Apache Airflow

GPTKB entity

Statements (63)
Predicate Object
gptkbp:instance_of gptkb:Workflow_Automation
gptkbp:community_support active community
gptkbp:developed_by gptkb:Apache_Software_Foundation
gptkbp:first_released gptkb:2014
gptkbp:has example DAGs
gptkbp:has_documentation official documentation
gptkbp:has_feature extensible architecture
gptkbp:has_features user authentication
role-based access control
task prioritization
email alerts
backfilling
task retries
task logging
task execution history
XComs (cross-communication between tasks)
sub DAGs
gptkbp:has_user_interface web-based UI
https://www.w3.org/2000/01/rdf-schema#label Apache Airflow
gptkbp:integrates_with gptkb:Kubernetes
gptkb:My_SQL
gptkb:Postgre_SQL
gptkb:Amazon_Web_Services
gptkb:Apache_Spark
gptkb:Google_Cloud_Platform
gptkbp:is_available_on gptkb:Git_Hub
gptkbp:is_compatible_with gptkb:Python_3
gptkbp:is_open_source gptkb:true
gptkbp:is_part_of Apache Software Foundation projects
gptkbp:is_scalable gptkb:true
gptkbp:is_supported_by commercial support options
gptkbp:is_used_by gptkb:Zalando
gptkb:Airbnb
gptkb:Lyft
gptkb:Reddit
gptkb:Shopify
gptkb:Uber
gptkb:Spotify
gptkb:Instacart
gptkb:Netflix
gptkb:Data_Robot
gptkbp:is_used_for ETL (Extract, Transform, Load)
data engineering
gptkbp:latest_version 2.5.0
gptkbp:license Apache License 2.0
gptkbp:notable_contributor open source contributors
gptkbp:provides monitoring and logging
task scheduling
gptkbp:released regular release cycle
gptkbp:runs_through cloud environments
on-premises servers
local machine
gptkbp:suitable_for large-scale data processing
data pipeline orchestration
complex workflows
gptkbp:supports task dependencies
dynamic pipeline generation
multiple executors
gptkbp:tutorials community tutorials
gptkbp:uses DAG (Directed Acyclic Graph)
gptkbp:written_in gptkb:Python
gptkbp:bfsParent gptkb:weapons
gptkbp:bfsLayer 3