MacBERT

GPTKB entity

Statements (22)
Predicate Object
gptkbp:instanceOf pre-trained language model
gptkbp:application Chinese NLP tasks
gptkbp:architecture gptkb:transformation
gptkbp:availableOn https://github.com/ymcui/MacBERT
gptkbp:basedOn gptkb:BERT
gptkbp:citation 1000+
gptkbp:developedBy gptkb:Huawei_Noah's_Ark_Lab
https://www.w3.org/2000/01/rdf-schema#label MacBERT
gptkbp:improves BERT (on Chinese benchmarks)
BERT masking strategy
gptkbp:language gptkb:Chinese
gptkbp:license Apache 2.0
gptkbp:notablePublication MacBERT: A Robust Pre-training Model for Chinese Language Understanding
gptkbp:pre-trainingTask gptkb:Masked_Language_Modeling
gptkbp:releaseYear 2020
gptkbp:supports machine reading comprehension
named entity recognition
sentence classification
gptkbp:uses n-gram masking
whole word masking
gptkbp:bfsParent gptkb:GLUE
gptkbp:bfsLayer 6