StatisticsGen

E457343

StatisticsGen is a TensorFlow Extended component that computes descriptive statistics over input datasets to support data analysis and validation in machine learning pipelines.

All labels observed (1)

Label Occurrences
StatisticsGen canonical 6

How this entity was disambiguated

Statements (46)

Predicate Object
instanceOf TFX component
TensorFlow Extended component
belongsTo data analysis stage of ML pipelines
data validation stage of ML pipelines
canCompute feature histograms
feature means
feature standard deviations
feature value counts
missing value statistics
compatibleWith Airflow
Apache Beam runners
linked to: Apache Beam

Kubeflow Pipelines
Vertex AI Pipelines
linked to: Vertex AI
configurableWith StatsOptions
developedBy Google
documentationURL https://www.tensorflow.org/tfx/guide/statsgen
hasParameter example_gen
output
stats_options
hasPurpose compute descriptive statistics over input datasets
support data analysis in machine learning pipelines
support data validation in machine learning pipelines
implementedIn Python
inputType ExampleGen output
tf.Example data
tf.Record files
license Apache License 2.0
outputFormat protocol buffers
outputType ExampleStatistics
statistics artifact
outputUsedBy ExampleValidator
SchemaGen
other downstream TFX components
partOf TFX pipeline
linked to: TFX

TensorFlow Extended
repositoryURL https://github.com/tensorflow/tfx
runsIn TFX orchestration environment
supports feature-wise statistics computation
per-split statistics computation
slice-based statistics computation
usedFor data validation
detecting data anomalies
exploratory data analysis
schema inference support
usesLibrary TensorFlow Data Validation
linked to: TF Data Validation

tfdv

How these facts were elicited

Referenced by (6)

Full triples — surface form annotated when it differs from this entity's canonical label.

TensorFlow Extended hasComponent StatisticsGen
TFX includesComponent StatisticsGen
ExampleGen precedes StatisticsGen
SchemaGen usedWith StatisticsGen
ExampleValidator integratesWith StatisticsGen
Pusher usedWith StatisticsGen