Parallel Computing and Supercomputing Resources

Resources for Parallel Computing and Supercomputing

This list is maintained at www.eecs.umich.edu/~qstout/parlinks.html where the entries are linked to the resource. Rather than creating a comprehensive, overwhelming, list of resources, I have tried to be selective, pointing to the best ones that I am aware of in each category. You can send me an email to suggest modifications at qstout@umich·edu

A slightly whimsical explanation of parallel computing.
Tutorials
- Parallel Computing 101, a tutorial for beginning and intermediate users, managers, people contemplating purchasing or building a parallel computer, etc.
- From Edinburgh Parallel Computing Center (EPCC): On-line courses include MPI, HPF, Mesh Generation, Introduction to Computational Science, HPC in Business.
- From NCSA: On-line courses include MPI, OpenMP, and multilevel parallel programming (MPI + OpenMP).
Distributed Systems Online, a thorough and up-to-date listing of parallel and supercomputing sites, books, and events, maintained by the IEEE Computer Society.
Newsgroups: comp.parallel, comp.sys.super (there are many others on more specialized topics)
Tools:
- METIS, free, a ``set of programs for partitioning graphs and for producing fill reducing orderings for sparse matrices''.
- Zoltan, free, ``includes many utilities needed by unstructured and/or adaptive parallel applications.''
- High Performance Math Software, with pointers and reviews of software for linear algebra, graph partitioning, PDE solvers, etc.
- Intel's collection of software products for analyzing and visualizing performance of distributed memory codes. These were formerly known as Vampir and Vampirtrace. They also have tools for thread analysis and debugging which can help with shared memory programming. This product was formerly known as Assure.
- , a debugger for MPI and OpenMP codes.
Languages and Language Extensions

MPI, Free, portable implementations are available at MPich and Open-MPI.
OpenMP the most important standard for shared-memory programming. Contains pointers to tutorials, texts, performance analyzers, etc.
Globus, the de facto standard for grid computing. Site contains pointers to references, tools, free implementations, etc.
Co-Array Fortran, a virtual shared memory language simulating shared memory on distributed memory machines.
UPC (Unified Parallel C), a virtual shared memory language simulating shared memory on distributed memory machines.

National HPCC Software Exchange (NHSE), a ``distributed collection of software, documents, data, and information of interest to the high performance and parallel computing community.''
Available systems: Most of the national resources available to the general scientific community within the US are organized within the Teragrid project. Some additional universities also have arrangements to allow outside users on their parallel systems. Many American university centers belong to the Coalition of Academic Scientific Computation (CASC), and can be located through the CASC web pages.
Top 500 listing of most powerful computers in the world (among those which are publically acknowledged).
Computational Science Graduate Fellowship Program, for PhD students who are US citizens or permanent residents and in their first or second year of graduate school.