Auto Loader

GPTKB entity

Statements (27)
Predicate Object
gptkbp:instanceOf gptkb:software
gptkbp:detects new files automatically
gptkbp:developedBy gptkb:Databricks
gptkbp:documentation https://docs.databricks.com/en/ingestion/auto-loader/index.html
gptkbp:enables real-time data pipelines
https://www.w3.org/2000/01/rdf-schema#label Auto Loader
gptkbp:integratesWith gptkb:Delta_Lake
Structured Streaming
gptkbp:introducedIn Databricks Runtime 7.2
gptkbp:monitors cloud storage directories
gptkbp:provides exactly-once processing
directory listing mode
file notification mode
gptkbp:reduces file listing costs
gptkbp:supports gptkb:Amazon_S3
gptkb:Google_Cloud_Storage
gptkb:Azure_Blob_Storage
gptkb:Azure_Data_Lake_Storage_Gen2
schema evolution
schema inference
cloud file sources
gptkbp:usedBy data scientists
data engineers
gptkbp:usedFor incremental data ingestion
gptkbp:usedIn gptkb:Databricks_Lakehouse_Platform
gptkbp:bfsParent gptkb:Databricks_Runtime_11.1
gptkbp:bfsLayer 8