Deep InfoMax

GPTKB entity

Statements (22)
Predicate Object
gptkbp:instanceOf unsupervised learning algorithm
gptkbp:application unsupervised representation learning
gptkbp:approach maximizing global and local mutual information
gptkbp:arXivID 1808.06670
gptkbp:citation 1000+
gptkbp:codeAvailable https://github.com/rdevon/DIM
gptkbp:describedBy Deep InfoMax: Learning Deep Representations by Mutual Information Estimation and Maximization
gptkbp:hasConcept maximizing mutual information between input and learned representation
https://www.w3.org/2000/01/rdf-schema#label Deep InfoMax
gptkbp:influenced CPC (Contrastive Predictive Coding)
MoCo
SimCLR
gptkbp:proposedBy gptkb:Aaron_van_den_Oord
gptkb:Oriol_Vinyals
Yazhe Li
gptkbp:publicationYear 2018
gptkbp:relatedTo contrastive learning
mutual information estimation
gptkbp:usedIn computer vision
natural language processing
gptkbp:bfsParent gptkb:MINE:_Mutual_Information_Neural_Estimation
gptkbp:bfsLayer 7