TAG
#pre-training
2 events tagged with this keyword
2018Model
BERT: Bidirectional Language Understanding
Google proposes BERT, achieving breakthrough language understanding through bidirectional Transformers.
#nlp#bert#transformer
2018Model
GPT-1: Generative Pre-Training
OpenAI releases GPT-1, first demonstrating the potential of generative pre-training on language understanding tasks.
#nlp#gpt#transformer