National Center for Computational Sciences

This page provides some links to non-NCCS sites with information on relevant HPC/parallel-computing topics that may be of interest. The links are categorized by subject.

Online UNIX Resources

• UNIX Help for Users
  Helpful information for users of the UNIX operating system; developed at the University of Edinburgh
• A Scientist’s and Engineer’s Guide to Workstations and Supercomputers
  An electronic survival kit from NACSE (Northwest Alliance for Computational Science & Engineering) for a scientific computing project from start to finish under a UNIX operating system
• University of Surrey
  UNIX Tutorial for Beginners
• Norman Matloff’s (University of California–Davis) UNIX and Linux Tutorial Center
• Vi Information
  • Vi Tutorial (Purdue Engineering Computing Network)
  • An Introduction to Display Editing with Vi
  • Mastering the Vi Editor
  • Vi Editor

Online Information on Fortran 90/95/2003

• Fortran 90, 95, and 2003 Home Page
  Fortran information and sources from King’s College (London)
• Fortran 90 Introduction
  A brief Fortran 90 tutorial with examples from Michigan Technological University
• An Interactive Fortran 90 Programming Course
  From University of Liverpool
• Paul Dubois’s “Large-scale simulations with Fortran 95″ notes (PDF)
• Drew McCormack’s “Fortran 90 Course” notes (PDF)

Online Information on C/C++

• Cplusplus.com

Online Information on Parallel Programming

• Designing and Building Parallel Programs
  An online book and tutorial by Ian Foster from Argonne National Laboratory.
• Parallel Programming Concepts
  This primer from the Cornell Theory Center introduces you to major concepts of parallel processing and its efficient realization.
• Distributed Memory Computing
  This presentation from the Cornell Theory Center provides you with an overview of the significant features of one type of parallel processing, distributed memory computing.

Online Information on OpenMP/Pthreads

• OpenMP Organization
  The official site, with specifications, C/C++/Fortran API, and tutorials, and links to OpenMP events
• OpenMPunity
  Community of OpenMP researchers and application developers

Online HPC References for Users

MPI

• Message Passing Interface Forum
  The official MPI standards documents, errata, and archives of the MPI Forum. The MPI Forum is an open group with representatives from many organizations that define and maintain the MPI standard.
• LAM MPI Tutorial
  A series of tutorials to introduce the more heavily used functions and demonstrate them in small examples or code fragments.
  
• Computational PDEs Unit: MPI Tutorial
  University of Leeds short tutorial on using MPI to solve partial differential equations using parallelized finite-difference methods.
• RS/6000 SP Practical MPI Programming (PDF)
  This is a very informative manual from IBM discussing both basic and advanced concepts of MPI programming. Much of the material is for the general MPI application and is not specific to IBM’s implementation.

Online References

• Program Optimization

To be added

• Numerical Libraries

To be added

HPC/Parallel Programming/MPI Reference Books

• Using MPI, by William Gropp, Ewing Lusk and Anthony Skjellum.
• RS/6000 Practical MPI Programming (PDF)
  This is a very informative manual from IBM discussing both basic and advanced concepts of MPI programming. Much of the material is for the general MPI application and is not specific to IBM’s implementation of MPI.
• An Introduction to Parallel Computing, Design and Analysis of Algorithms, 2nd edition, by Ananth Grama, Anshul Gupta, George Karypis, and Vipin Kumar.
• Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation, by George Em Karniadakis and Robert M. Kirby II.
• Parallel Programming, 2nd edition, by Barrry Wilkinson.