ChatGPT: Principles and Architecture bridges the knowledge gap between theoretical AI concepts and their practical applications. It equips industry professionals and researchers with a deeper understanding of large language models, enabling them to effectively leverage these technologies in their respective fields. In addition, it tackles the complexity of understanding large language models and their practical applications by demystifying underlying technologies and strategies used in developing ChatGPT and similar models. By combining theoretical knowledge with real-world examples, the book enables readers to grasp the nuances of AI technologies, thus paving the way for innovative applications and solutions in their professional domains.
Sections focus on the principles, architecture, pretraining, transfer learning, and middleware programming techniques of ChatGPT, providing a useful resource for the research and academic communities. It is ideal for the needs of industry professionals, researchers, and students in the field of AI and computer science who face daily challenges in understanding and implementing complex large language model technologies.
1. Title of Book - p. i 2. Cover image - p. i 3. Title page - p. ii 4. Table of Contents - p. iii 5. Copyright - p. iv 6. Preface - p. ix 7. Acknowledgments - p. xiii 8. Chapter 1. A new milestone in artificial intelligence—ChatGPT - p. 1 9. Chapter 2. In-depth understanding of the transformer model - p. 21 10. Chapter 3. Generative pretraining - p. 47 11. Chapter 4. Unsupervised multitask and zero-shot learning - p. 61 12. Chapter 5. Sparse attention and content-based learning - p. 79 13. Chapter 6. Pretraining strategies for large language models - p. 99 14. Chapter 7. Proximal policy optimization - p. 123 15. Chapter 8. Human feedback reinforcement learning - p. 137 16. Chapter 9. Low-resource domain transfer of large language models - p. 157 17. Chapter 10. Middleware - p. 177 18. Chapter 11. The future path of large language models - p. 187 19. Index - p. 205
ChatGPT: Principles and Architecture bridges the knowledge gap between theoretical AI concepts and their practical applications. It equips industry professionals and researchers with a deeper understanding of large language models, enabling them to effectively leverage these technologies in their respective fields. In addition, it tackles the complexity of understanding large language models and their practical applications by demystifying underlying technologies and strategies used in developing ChatGPT and similar models. By combining theoretical knowledge with real-world examples, the book enables readers to grasp the nuances of AI technologies, thus paving the way for innovative applications and solutions in their professional domains.
Sections focus on the principles, architecture, pretraining, transfer learning, and middleware programming techniques of ChatGPT, providing a useful resource for the research and academic communities. It is ideal for the needs of industry professionals, researchers, and students in the field of AI and computer science who face daily challenges in understanding and implementing complex large language model technologies.
1. Title of Book - p. i 2. Cover image - p. i 3. Title page - p. ii 4. Table of Contents - p. iii 5. Copyright - p. iv 6. Preface - p. ix 7. Acknowledgments - p. xiii 8. Chapter 1. A new milestone in artificial intelligence—ChatGPT - p. 1 9. Chapter 2. In-depth understanding of the transformer model - p. 21 10. Chapter 3. Generative pretraining - p. 47 11. Chapter 4. Unsupervised multitask and zero-shot learning - p. 61 12. Chapter 5. Sparse attention and content-based learning - p. 79 13. Chapter 6. Pretraining strategies for large language models - p. 99 14. Chapter 7. Proximal policy optimization - p. 123 15. Chapter 8. Human feedback reinforcement learning - p. 137 16. Chapter 9. Low-resource domain transfer of large language models - p. 157 17. Chapter 10. Middleware - p. 177 18. Chapter 11. The future path of large language models - p. 187 19. Index - p. 205
