|
gptkbp:instance_of
|
gptkb:software
|
|
gptkbp:can
|
periodic tasks
one-off tasks
|
|
gptkbp:can_be_extended_by
|
plugins
|
|
gptkbp:deployment
|
gptkb:Kubernetes
gptkb:Docker
VMs
|
|
gptkbp:developed_by
|
gptkb:Apache_Software_Foundation
|
|
gptkbp:first_released
|
gptkb:2014
|
|
gptkbp:has
|
gptkb:Joint_Task_Force
gptkb:Amazon_Web_Services
REST API
user authentication
community support
command line interface
executor
task queue
metadata database
scheduler that supports backfilling
|
|
https://www.w3.org/2000/01/rdf-schema#label
|
Airflow
|
|
gptkbp:integrates_with
|
gptkb:Amazon_Web_Services
gptkb:Apache_Spark
gptkb:Google_Cloud_Platform
gptkb:Hadoop
|
|
gptkbp:is_compatible_with
|
gptkb:Java
gptkb:SQL
gptkb:R
gptkb:Python_3
gptkb:Bash
|
|
gptkbp:is_open_source
|
gptkb:true
|
|
gptkbp:is_used_by
|
gptkb:Airbnb
gptkb:Lyft
gptkb:Spotify
gptkb:Instacart
gptkb:Netflix
|
|
gptkbp:latest_version
|
2.4.0
|
|
gptkbp:provides
|
data lineage tracking
logging capabilities
alerting features
UI for monitoring
task timeouts
task retries
|
|
gptkbp:supports
|
task prioritization
task dependencies
dynamic pipeline generation
DAGs
multiple executors
multiple languages for tasks
parameterized tasks
|
|
gptkbp:used_for
|
workflow automation
|
|
gptkbp:uses
|
Celery for task execution
|
|
gptkbp:written_in
|
gptkb:Python
|
|
gptkbp:bfsParent
|
gptkb:Py_Torch
|
|
gptkbp:bfsLayer
|
4
|