3 hrs. Fundamental concepts, techniques, and tools of parallel computer architectures, parallel algorithm design, performance and scalability, MPI and open MP programming, matrix computation, and solving linear system. Introduction to distributed computing.