Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming offers a comprehensive reference on high-performance computing (HPC). Laying the groundwork for the companion text, High-Performance Computing: Applications and Frontiers, this book serves as a comprehensive introduction to the fundamental concepts, systems, and introductory programming techniques. It focuses on infrastructure, programming basics, and practical access to HPC systems, covering the evolution of HPC and offering an architectural overview of HPC systems. In addition, it explores resource management and performance metrics in parallel systems, discussing practical access to HPC and considering the concepts behind distributed and shared memory.
Other sections focuses on OpenMP for multithreading, MPI programming, GPU computing, OpenACC, and CUDA, and parallel I/O, data management, filesystems, cloud based HPC, and virtualization. The book concludes with a reference and glossary, equipping the reader with a thorough grounding in the basics of HPC and providing a comprehensive, multidisciplinary guide on the principles and concepts that underpin high performance computing. It is designed for graduate students, early-career professionals, and researchers seeking to build a solid foundation in HPC.
1. Part 1: Introduction to high-performance computing - p. P1 2. Chapter 1. Fundamentals of high-performance computing - p. 3 3. Chapter 2. Evolution of high-performance computing - p. 23 4. Chapter 3. Architectural overview of high-performance computing systems - p. 53 5. Part 2: High-performance computing essentials - p. P93 6. Chapter 4. Resource management and performance metrics in parallel systems - p. 95 7. Chapter 5. Practical access to high-performance computing - p. 131 8. Chapter 6. Distributed and shared memory concepts - p. 149 9. Part 3: Foundations of parallel programming - p. P173 10. Chapter 7. OpenMP for multithreading - p. 175 11. Chapter 8. Deep dive into MPI programming - p. 221 12. Chapter 9. Introduction to GPU computing, OpenACC, and CUDA basics - p. 277 13. Chapter 10. Using high-performance libraries - p. 323 14. Chapter 11. Scalable parallel algorithms & modern data‑intensive workflows - p. 361 15. Chapter 12. Fundamentals of distributed machine learning - p. 413 16. Part 4: Practical high-performance computing infrastructure - p. P477 17. Chapter 13. Profiling, debugging, performance analysis tools and the role of checkpointing - p. 478 18. Chapter 14. Parallel I/O, high throughput data management, and parallel file systems - p. 527 19. Chapter 15. Cloud-based high-performance computing and virtualization/containerization - p. 557 20. Chapter 16. Introduction to visualization techniques - p. 589 21. Chapter 17. High performance computing software engineering practices - p. 615 22. Part 5: Conclusion and reference material - p. P677 23. Chapter 18. Advanced computing: the journey toward post-exascale era - p. 679 24. Chapter 19. Reflections and future horizons in high-performance computing - p. 701 25. Glossary - p. 711 26. Index - p. 719
Foundations of High Performance Computing: A Comprehensive Guide to Systems, Concepts, and Programming offers a comprehensive reference on high-performance computing (HPC). Laying the groundwork for the companion text, High-Performance Computing: Applications and Frontiers, this book serves as a comprehensive introduction to the fundamental concepts, systems, and introductory programming techniques. It focuses on infrastructure, programming basics, and practical access to HPC systems, covering the evolution of HPC and offering an architectural overview of HPC systems. In addition, it explores resource management and performance metrics in parallel systems, discussing practical access to HPC and considering the concepts behind distributed and shared memory.
Other sections focuses on OpenMP for multithreading, MPI programming, GPU computing, OpenACC, and CUDA, and parallel I/O, data management, filesystems, cloud based HPC, and virtualization. The book concludes with a reference and glossary, equipping the reader with a thorough grounding in the basics of HPC and providing a comprehensive, multidisciplinary guide on the principles and concepts that underpin high performance computing. It is designed for graduate students, early-career professionals, and researchers seeking to build a solid foundation in HPC.
1. Part 1: Introduction to high-performance computing - p. P1 2. Chapter 1. Fundamentals of high-performance computing - p. 3 3. Chapter 2. Evolution of high-performance computing - p. 23 4. Chapter 3. Architectural overview of high-performance computing systems - p. 53 5. Part 2: High-performance computing essentials - p. P93 6. Chapter 4. Resource management and performance metrics in parallel systems - p. 95 7. Chapter 5. Practical access to high-performance computing - p. 131 8. Chapter 6. Distributed and shared memory concepts - p. 149 9. Part 3: Foundations of parallel programming - p. P173 10. Chapter 7. OpenMP for multithreading - p. 175 11. Chapter 8. Deep dive into MPI programming - p. 221 12. Chapter 9. Introduction to GPU computing, OpenACC, and CUDA basics - p. 277 13. Chapter 10. Using high-performance libraries - p. 323 14. Chapter 11. Scalable parallel algorithms & modern data‑intensive workflows - p. 361 15. Chapter 12. Fundamentals of distributed machine learning - p. 413 16. Part 4: Practical high-performance computing infrastructure - p. P477 17. Chapter 13. Profiling, debugging, performance analysis tools and the role of checkpointing - p. 478 18. Chapter 14. Parallel I/O, high throughput data management, and parallel file systems - p. 527 19. Chapter 15. Cloud-based high-performance computing and virtualization/containerization - p. 557 20. Chapter 16. Introduction to visualization techniques - p. 589 21. Chapter 17. High performance computing software engineering practices - p. 615 22. Part 5: Conclusion and reference material - p. P677 23. Chapter 18. Advanced computing: the journey toward post-exascale era - p. 679 24. Chapter 19. Reflections and future horizons in high-performance computing - p. 701 25. Glossary - p. 711 26. Index - p. 719
