CIDEr

E899060

CIDEr is an automatic evaluation metric designed to assess the quality of image captions by measuring their consensus with human-written descriptions.

All labels observed (5)

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf automatic evaluation metric
image captioning evaluation metric
image captioning evaluation metric
aggregationMethod averaging over reference captions
basedOn consensus among human reference captions
commonlyReportedIn image captioning research papers
commonlyUsedWith neural image captioning models
comparesTo human-written image descriptions
correlatesWith human caption quality assessments
designedFor evaluating image caption quality
image captioning
designedTo reduce the effect of outlier n-grams
domain image description
evaluatedOn MS COCO dataset
linked to: MSCOCO
evaluates machine-generated image captions
focusesOn content similarity between candidate and reference captions
fullName CIDEr with damping
linked to: CIDEr

Consensus-based Image Description Evaluation
linked to: CIDEr
hasAuthor C. Lawrence Zitnick
Devi Parikh
Ramakrishna Vedantam
hasVariant CIDEr-D
linked to: CIDEr
higherIsBetter true
introducedAt ECCV 2015
introducedFor automatic image caption evaluation
introducedInField computer vision
natural language processing
introducedYear 2015
languageAgnostic partially
metricRange 0 to 1
optimizedFor correlation with human judgments
paperTitle CIDEr: Consensus-based Image Description Evaluation
linked to: CIDEr
publicationType research paper
relatedMetric BLEU
METEOR
ROUGE-L
SPICE
requires multiple human reference captions per image
status standard benchmark metric for image captioning
taskType reference-based evaluation
usedIn MS COCO Captioning Challenge
uses TF-IDF weighting of n-grams
cosine similarity over TF-IDF vectors
n-gram matching
term frequency-inverse document frequency weighting

How these facts were elicited

Referenced by (8)

Full triples — surface form annotated when it differs from this entity's canonical label.

MSCOCO evaluationMetric CIDEr
CIDEr fullName Consensus-based Image Description Evaluation
linked to: CIDEr
CIDEr paperTitle CIDEr: Consensus-based Image Description Evaluation
linked to: CIDEr
CIDEr hasVariant CIDEr-D
linked to: CIDEr
CIDEr-D fullName CIDEr with damping
subject linked to: CIDEr
linked to: CIDEr