Welcome students! ... to the Parallel Computing course, edition Spring 2016. I will keep updating this page regularly. If you have questions related to that course feel free to email me.
Most of us have learned to program a single microprocessor (single core) using a high-level programming language like C/C++, Java, ... This is called sequential programming. We feel very comfortable with this because we think in sequential way and give the machine statements to be executed in sequence. However, this has to change. A microprocessor with single core no longer exists in almost all computers we are using today (including your tablets and smart phones). Most of our devices are now multicore processors. A multicore processor contains several core (called CPUs or cores) on-chip. To make the best use of these multicore chips we need to program them in-parallel. Sequential programming, for all platforms from smartphones to supercomputers, is falling out of fashion and taking back-seat to parallel programming.
How to think in parallel? How to write code in parallel to make the best use of the underlying hardware? How is that new hardware different from the traditional one? What will the future be for the software and hardware? This is the topic of this course.
Here is some basic information about this course:
Mailing ListSign up for the Mailman mailing list for the course, if the system has not already signed you.
Lecture Notes and Schedule
|1||1/25||Why Parallel Computing?|
|2||1/27||Parallel Hardware: Basics|
|3||2/1||Parallel Hardware: Advanced|
|4||2/3||Parallel Software: Basics|
|5||2/8||Parallel Software: Advanced|
|2/15||No class: President's day|
|8||2/24||MPI II (cont'd)|
|11||3/7||MPI Last Touch|
|3/14||No class: Spring Recess|
|3/16||No class Spring Recess|
|16||4/6||OpenMP Last Touch|
|17||4/11||GPU - Intro|
|20||4/25||CUDA III (cont'd)|
|23||5/4||CUDA - Last Touch|
module load mpi/mpich-x86_64
cp -r /usr/local/cuda/samples ~/samples
After that, each time you need to do CUDA programming, you need only to do step1.
lab 3: you will also need this file - due May 4th
Interesting Links (Geeky stuff )
If you have an interesting link, please email it to the instructor and it will find its way to this page.Top500 Supercomputers in the world