Parlez-vous ChatGPT ?

• 2015. OpenAI was founded by Sam Altman, Elon Musk, Greg Brockman, Peter Thiel, and others. OpenAI develops many different AI models other than GPT.

• 2017. Google published the paper Attention is All You Need, which introduced the transformer architecture [2]. The transformer is a neural network architecture that lays the foundation for many state-of-the-art (SOTA) large language models (LLM) like GPT.

• 2018. GPT is introduced in Improving Language Understanding by Generative Pre-training [3]. It’s based on a modified transformer architecture and pre-trained on a large corpus.

• 2019. GPT-2 is introduced in Language Models are Unsupervised Multitask Learners [4], which can perform a range of tasks without explicit supervision when training.

• 2020. GPT-3 is introduced in Language Models are Few-Shot Learners [5], which can perform well with few examples in the prompt without fine-tuning.

• 2022. InstructGPT is introduced in Training language models to follow instructions with human feedback [6], which can better follow user instructions by fine-tuning with human feedback.

• 2022. ChatGPT, a sibling of InstructGPT, is introduced in ChatGPT: Optimizing Language Models for Dialogue. It can interact with humans in conversations, thanks to the fine-tuning with human examples and reinforcement learning from human feedback (RLHF).

Natural language processing (NLP) 

The transformer architecture is the foundation for GPT. 

The first step is supervised learning from human examples. 

The second step is training a reward model (RM) to rate the responses

Optimizing Language Models for Dialogue.

NLP Using Python     Natural Language Processing

Machine Learning Mastery

    Le terme "Prompt" en anglais peut avoir plusieurs significations en fonction du contexte. En matière d'intelligence artificielle, le terme "Prompt" peut être traduit par "invite" ou "proposition".  PromptBase | Prompt Marketplace: DALL·E, Midjourney, ChatGPT, Stable Diffusion & GPT-3 

https://promptbase.com/

À partir de l’adresse <https://rocblanc.blogspot.com/2023/03/les-url-des-presentations-chatgpt-de-p.html> 

À partir de l’adresse <https://bootcamp.uxdesign.cc/how-chatgpt-really-works-explained-for-non-technical-people-71efb078a5c9> 

https://www.meetup.com/andorra-mindset-changers/events/292660811/?utm_medium=referral&utm_campaign=share-btn_savedevents_share_modal&utm_source=link

--- 

Erol GIRAUDY

https://www.erolgiraudy.eu