Performance Computing: Modern Systems and Practices is a fully comprehensive and easily accessible treatment of high performance computing, covering fundamental concepts and essential knowledge while also providing key skills training. With this book, students will begin their careers with an understanding of possible directions for future research and development in HPC, domain scientists will learn how to use supercomputers as a key tool in their quest for new knowledge, and practicing engineers will discover how supercomputers can employ HPC systems and methods to the design and simulation of innovative products. This new edition has been fully updated, and has been reorganized and restructured to improve accessibility for undergraduate students while also adding trending content such as machine learning and a new chapter on CUDA.
1. Chapter 1. An Introduction to High Performance Computing and This Textbook - p. 1 2. Chapter 2. Commodity Clusters - p. 19 3. Chapter 3. Foundational Concepts of High Performance Computing Through a Brief History - p. 49 4. Chapter 4. Models and Metrics for Machines - p. 67 5. Chapter 5. Benchmarking - p. 83 6. Chapter 6. Libraries - p. 105 7. Chapter 7. The Essential SLURM: Resource Management - p. 119 8. Chapter 8. Visualization - p. 153 9. Chapter 9. Performance Monitoring and Measurement - p. 177 10. Chapter 10. Symmetric Multiprocessor Architecture - p. 201 11. Chapter 11. The Essential OpenMP - p. 221 12. Chapter 12. Examples for Multiple-Thread Shared-Memory Programs - p. 247 13. Chapter 13. Distributed Memory Architecture - p. 259 14. Chapter 14. The Essential MPI - p. 269 15. Chapter 15. Examples for Message-Passing Programs - p. 303 16. Chapter 16. Heterogeneous and Graphical Processor Unit Computer Architecture - p. 325 17. Chapter 17. The Essential OpenAC - p. 339 18. Chapter 18. Examples of GPU Programs - p. 371 19. Chapter 19. Machine Learning - p. 383 20. Chapter 20. Mass Storage and File Systems - p. 395 21. Chapter 21. Intermediate MPI - p. 435 22. Chapter 22. Checkpointing - p. 463 23. Chapter 23. Computing in the Future: A Personal Perspective - p. 477 24. Index - p. 491
Performance Computing: Modern Systems and Practices is a fully comprehensive and easily accessible treatment of high performance computing, covering fundamental concepts and essential knowledge while also providing key skills training. With this book, students will begin their careers with an understanding of possible directions for future research and development in HPC, domain scientists will learn how to use supercomputers as a key tool in their quest for new knowledge, and practicing engineers will discover how supercomputers can employ HPC systems and methods to the design and simulation of innovative products. This new edition has been fully updated, and has been reorganized and restructured to improve accessibility for undergraduate students while also adding trending content such as machine learning and a new chapter on CUDA.
1. Chapter 1. An Introduction to High Performance Computing and This Textbook - p. 1 2. Chapter 2. Commodity Clusters - p. 19 3. Chapter 3. Foundational Concepts of High Performance Computing Through a Brief History - p. 49 4. Chapter 4. Models and Metrics for Machines - p. 67 5. Chapter 5. Benchmarking - p. 83 6. Chapter 6. Libraries - p. 105 7. Chapter 7. The Essential SLURM: Resource Management - p. 119 8. Chapter 8. Visualization - p. 153 9. Chapter 9. Performance Monitoring and Measurement - p. 177 10. Chapter 10. Symmetric Multiprocessor Architecture - p. 201 11. Chapter 11. The Essential OpenMP - p. 221 12. Chapter 12. Examples for Multiple-Thread Shared-Memory Programs - p. 247 13. Chapter 13. Distributed Memory Architecture - p. 259 14. Chapter 14. The Essential MPI - p. 269 15. Chapter 15. Examples for Message-Passing Programs - p. 303 16. Chapter 16. Heterogeneous and Graphical Processor Unit Computer Architecture - p. 325 17. Chapter 17. The Essential OpenAC - p. 339 18. Chapter 18. Examples of GPU Programs - p. 371 19. Chapter 19. Machine Learning - p. 383 20. Chapter 20. Mass Storage and File Systems - p. 395 21. Chapter 21. Intermediate MPI - p. 435 22. Chapter 22. Checkpointing - p. 463 23. Chapter 23. Computing in the Future: A Personal Perspective - p. 477 24. Index - p. 491
