1. GPT-1
Improving Language Understandingby Generative Pre-Training
What the problem GPT-1 solve?
Before GPT-1, NLP was usually a supervised model. For each task, there are some labeled data, and then develop a suoervised model based on these labeled data. There are several problems with this approach: First, labeled data is …