A Practical Approach to High-Performance Computing

Description

The book discusses the fundamentals of high-performance computing. The authors combine visualization, comprehensibility, and strictness in their material presentation, and thus influence the reader towards practical application and learning how to solve real computing problems. They address both key approaches to programming modern computing systems: multithreading-based parallelizing in shared memory systems, and applying message-passing technologies in distributed systems. The book is suitable for undergraduate and graduate students, and for researchers and practitioners engaged with high-performance computing systems. Each chapter begins with a theoretical part, where the relevant terminology is introduced along with the basic theoretical results and methods of parallel programming, and concludes with a list of test questions and problems of varying difficulty. The authors include many solutions and hints, and often sample code. Front Matter ....Pages i-xi Classification of Computing System Architectures (Sergei Kurgalin, Sergei Borzunov)....Pages 1-5 Topologies of Computer Networks (Sergei Kurgalin, Sergei Borzunov)....Pages 7-15 Fundamentals of Parallel Computing (Sergei Kurgalin, Sergei Borzunov)....Pages 17-35 The MPI Technology (Sergei Kurgalin, Sergei Borzunov)....Pages 37-66 The OpenMP Technology (Sergei Kurgalin, Sergei Borzunov)....Pages 67-92 Implementation of Parallel Algorithms (Sergei Kurgalin, Sergei Borzunov)....Pages 93-115 Back Matter ....Pages 117-206