The previous notes introduced the text generation models (GPT family). This reading note is about image generator papers.

Similar to text generator which generate the next token, OpenAI has image-GPT which is a large transformer trained on next pixel prediction in which the pixels are concated into a vector to …

1. GPT-1

Improving Language Understandingby Generative Pre-Training

What the problem GPT-1 solve?

Before GPT-1, NLP was usually a supervised model. For each task, there are some labeled data, and then develop a suoervised model based on these labeled data. There are several problems with this approach: First, labeled data is …

multi-armed bandit and how to use it in CTR optimization

paper reading and summary

Recommendation system introduction - collaborative filtering, DNN for query and item embedding

1. people skill: 组织，交流，setup vision -> roadmap -> project -> milestone -> metrics, 怎么improve people，怎么evaluate people
2. 工作努力，但是nobody understand you。会不会too techinical，要understand your audience，更要understand你的audience想要什么，让他们明白80%，在留给 …