MacBERT

GPTKB entity

Statements (23)
Predicate Object
gptkbp:instanceOf gptkb:pre-trained_language_model
gptkbp:application Chinese NLP tasks
gptkbp:architecture gptkb:transformation
gptkbp:availableOn https://github.com/ymcui/MacBERT
gptkbp:basedOn gptkb:BERT
gptkbp:citation 1000+
gptkbp:developedBy gptkb:Huawei_Noah's_Ark_Lab
gptkbp:improves BERT (on Chinese benchmarks)
BERT masking strategy
gptkbp:language gptkb:Chinese
gptkbp:license Apache 2.0
gptkbp:notablePublication MacBERT: A Robust Pre-training Model for Chinese Language Understanding
gptkbp:pre-trainingTask gptkb:Masked_Language_Modeling
gptkbp:releaseYear 2020
gptkbp:supports machine reading comprehension
named entity recognition
sentence classification
gptkbp:uses n-gram masking
whole word masking
gptkbp:bfsParent gptkb:GLUE
gptkb:Chinese_BERT
gptkbp:bfsLayer 8
https://www.w3.org/2000/01/rdf-schema#label MacBERT