Practical Parallel Computing (eBook)

H. Stephen Morse (Autor)

eBook Download: PDF

2014 | 1. Auflage
420 Seiten
Elsevier Science (Verlag)
978-1-4832-1419-1 (ISBN)

Infos

Practical Parallel Computing provides information pertinent to the fundamental aspects of high-performance parallel processing. This book discusses the development of parallel applications on a variety of equipment. Organized into three parts encompassing 12 chapters, this book begins with an overview of the technology trends that converge to favor massively parallel hardware over traditional mainframes and vector machines. This text then gives a tutorial introduction to parallel hardware architectures. Other chapters provide worked-out examples of programs using several parallel languages. This book deals as well with benchmarking and performance estimation on parallel machines. The final chapter provides a structured, flexible methodology for selecting a parallel machine and for integrating it into operations. This book is a valuable resource for readers who are confronted with the practical realities of parallel computing for the first time. Mid-level technical managers, algorithm designers, computer scientists, and doctorate-level mathematicians will also find this book extremely useful.

Inhalt

Front Cover 1
Practical Parallel Computing 4
Copyright Page 5
Table of Contents 8
Dedication 6
Preface 14
Acknowledgments 18
PART 1: Preliminaries 20
Chapter 1. The Status and Future of Massively Parallel Processing 22
1.1 Technology Trends Favoring Parallel Architectures 23
1.2 Obstacles Inhibiting Commercial Success 31
1.3 Trends and Considerations 38
Chapter 2. Can Parallel Machines Be Used Efficiently? 44
2.1 A Parallel Parable: Building a Wall 45
2.2 Amdahl's Law 51
2.3 Examples 62
Chapter 3. An Introduction to Hardware Architectures 70
3.1 Impacts of Hardware Architecture 71
3.2 A Primer on Interconnection Networks 74
3.3 SIMD Machines 79
3.4 Distributed Memory MIMD Machines 86
3.5 Shared Memory MIMD Machines 92
PART 2: Software Issues 104
Chapter 4. Shared Memory Parallel Language Constructs 106
4.1 Basic Concepts for Shared Memory Parallel Programming 107
4.2 The Sample Problem on an SGI Challenge SMP 117
4.3 Observations and Considerations 125
Chapter 5. Message Passing 130
5.1 An Overview of the Message-Passing Library 130
5.2 The Sample Problem on an nCube 2 135
5.3 Express 146
5.4 Intel Paragon 157
5.5 Observations and Considerations 164
Chapter 6. SIMD and Array-Based Languages 170
6.1 An Overview 170
6.2 MPL on the MasPar MP-1 176
6.3 C* on the Connection Machine 186
Chapter 7. Linda 198
7.1 A Linda Primer 199
7.2 The Sample Problem in Linda 203
7.3 Observations and Considerations 210
Chapter 8. The Development Environment for Parallel Software 214
8.1 Compilers 215
8.2 Debugging Parallel Code 219
8.3 Profilers and Load Balancing 224
8.4 Other Tools 227
Chapter 9. Operating System Issues 234
9.1 Multiple Users 235
9.2 Virtual Address Spaces 239
9.3 Scheduling 242
9.4 Virtual Processors 244
9.5 I/O 246
9.6 Open Systems 250
PART 3: Management Issues 254
Chapter 10. Benchmarking Parallel Applications 256
10.1 Dependence on Problem Size and Machine Size 257
10.2 Publicly Available Parallel Benchmarks 273
10.3 Scaling Sequential Performance to Parallel Performance 278
10.4 Estimating Performance 281
10.5 Questions to Ask Vendors 285
Chapter 11. Porting and Developing Parallel Applications 288
11.1 Porting Strategies 289
11.2 Developing Parallel Applications 297
11.3 Examples 302
Chapter 12. Matching Applications to Architectures 314
12.1 A Methodology 315
12.2 Integrating a Parallel Machine into Existing Operations 325
Appendix A: The Sample Problem 336
Appendix B: SGI Challenge 342
Appendix C: nCube 350
Appendix D: Express 360
Appendix E: Intel Paragon 368
Appendix F: MasPar MP-1 374
Appendix G: C* on the Connection Machine 382
Appendix H: Linda 388
Appendix I: Two Recent Machines 398
I.1 The SP-Series from IBM 398
I.2 Exemplar Series from Convex Corp 402
I.3 Summary and Comparison 404
References 406
Index 412

Produkt-Details

• Erscheint lt. Verlag: 10.5.2014
• Sprache: englisch
• Themenwelt: Mathematik / Informatik ► Informatik ► Theorie / Studium
• Themenwelt: Informatik ► Weitere Themen ► Hardware
• Themenwelt: Mathematik / Informatik ► Mathematik
• Themenwelt: Technik
• ISBN-10: 1-4832-1419-2 / 1483214192
• ISBN-13: 978-1-4832-1419-1 / 9781483214191