National Center for Computational Sciences

This page provides some links to both NCCS and non-NCCS sites with information on relevant HPC/parallel-computing topics that may be of interest. The links are categorized by subject.

Using NCCS HPC Systems

• Quick Overview of NCCS
  (Full Color PDF) | (B/W Print Version PDF)
• A Quick Start Guide to NCCS Jaguar System
  (Full Color PDF) | (B/W Print Version PDF)
• A Guide to Using NCCS Jaguar System
  (Full Color PDF) | (B/W Print Version PDF)
• Introduction to Parallel Computing with MPI
  (Full Color PDF) | (B/W Print Version PDF) + Examples Page
• Using Parallel IO
  (Full Color PDF) | (B/W Print Version PDF)
• PGI and Cray Compiler Optimization
  (Full Color PDF) | (B/W Print Version PDF)
• MPI Optimization and Tips
  (Full Color PDF) | (B/W Print Version PDF)
• Introduction to the Cray PAT
  (Full Color PDF) | (B/W Print Version PDF)

Online Information on Parallel Programming

• “Introduction to Parallel Computing”
  Online material from Lawrence Livermore National Laboratory
• Designing and Building Parallel Programs
  An online book and tutorial by Ian Foster from Argonne National Laboratory.
• Parallel Programming Concepts
  This primer from the Cornell Theory Center introduces you to major concepts of parallel processing and its efficient realization.
• Distributed Memory Computing
  This presentation from the Cornell Theory Center provides you with an overview of the significant features of one type of parallel processing, distributed memory computing.

Online Information on OpenMP/Pthreads

• OpenMP Organization
  The official site, with specifications, C/C++/Fortran API, and tutorials, and links to OpenMP events
• OpenMPunity
  Community of OpenMP researchers and application developers

Online MPI References for Users

• Message Passing Interface Forum
  The official MPI standards documents, errata, and archives of the MPI Forum. The MPI Forum is an open group with representatives from many organizations that define and maintain the MPI standard.
• “Message Passing Interface (MPI)”
  Online material from Lawrence Livermore National Laboratory
• LAM MPI Tutorial
  A series of tutorials to introduce the more heavily used functions and demonstrate them in small examples or code fragments.
• RS/6000 SP Practical MPI Programming (PDF)
  This is a very informative manual from IBM discussing both basic and advanced concepts of MPI programming. Much of the material is for the general MPI application and is not specific to IBM’s implementation.

Online Information on Fortran 90/95/2003

• Fortran 90, 95, and 2003 Home Page
  Fortran information and sources from King’s College (London)
• Fortran 90 Introduction
  A brief Fortran 90 tutorial with examples from Michigan Technological University
• An Interactive Fortran 90 Programming Course
  From University of Liverpool
• Paul Dubois’s “Large-scale simulations with Fortran 95″ notes (PDF)
• Drew McCormack’s “Fortran 90 Course” notes (PDF)

Online Information on C/C++

• Cplusplus.com
  The C++ Resources Network
• The C Book
  An online version of The C Book. Free to download

Programming Optimization

• Programming Optimization: Techniques, examples and discussion
  Some program performance optimization techniques
• Optimizing C and C++ Code
  The article explores the optimization techniques for C and C++ code developed for Real-time and Embedded Systems.

HPC/Parallel Programming Reference Books

• Using MPI, by William Gropp, Ewing Lusk and Anthony Skjellum.
• “RS/6000 Practical MPI Programming” (PDF)
  This is a very informative manual from IBM discussing both basic and advanced concepts of MPI programming. Much of the material is for the general MPI application and is not specific to IBM’s implementation of MPI.
• “An Introduction to Parallel Computing, Design and Analysis of Algorithms”, 2nd edition, by Ananth Grama, Anshul Gupta, George Karypis, and Vipin Kumar.
• “Parallel Scientific Computing in C++ and MPI: A Seamless Approach to Parallel Algorithms and their Implementation”, by George Em Karniadakis and Robert M. Kirby II.
• “Parallel Programming”, 2nd edition, by Barrry Wilkinson.
• “Using OpenMP”, by Barbara Chapman, Gabrielle Jost and Ruud van der Pas

Online UNIX Resources

• UNIX Help for Users
  Helpful information for users of the UNIX operating system; developed at the University of Edinburgh
• UNIX Tutorial for Beginners
  University of Surrey
• Norman Matloff’s UNIX and Linux Tutorial Center
  University of California – Davis
• Vi Information
  • Vi Tutorial (Purdue Engineering Computing Network)
  • An Introduction to Display Editing with Vi
  • Mastering the Vi Editor
  • Vi Editor