An introductory Udacity course on parallel programming using CUDA on Nvidia GPUs, covering parallel algorithm design and GPU programming from the basics. It is co-taught by an Nvidia Research engineer and a UC Davis professor (John Owens).

Commenters call it a free, easy-to-follow starting point that explains the algorithms well and teaches practical CUDA.

What commenters said (6)

1. Strongly recommendsChristianGeek2016in “CS 179: GPU Programming”

   I'm taking a free course in CUDA programming on Udacity at the moment that's co-taught by a guy from NVIDIA Research and a professor from UC Davis. If you're looking for something that starts from the basics and is really easy to follow, I highly recommend it.

   https://www.udacity.com/course/intro-to-parallel-programming...

2. Recommendsrandyzwitch2018in “Ask HN: What are the best MOOCs you've taken?”

   I found Udacity CS344: Intro to Parallel Programming (CUDA) a great class, not only from a practical standpoint of learning CUDA but also had some decent explanations/whiteboarding behind the algorithms

3. Recommendsbillconan2017in “Ask HN: Where are the most jobs in parallel computing?”

   you can take this course

   https://www.udacity.com/course/intro-to-parallel-programming...

   John Owens is a good teacher. He helped me get started on CUDA.

4. Mentionscodesushi422019in “The beauty of functional languages in deep learning – Clojure and Haskell”

   See Udacity's course on parallel programming:

   https://www.youtube.com/watch?v=F620ommtjqk&list=PLGvfHSgImk...

   I don't think it touches upon ML, but it is relevant for understanding the difference between GPUs and CPUs. You can go through the intro to backprop lectures on deeplearning.ai for ML.

5. Mentionshackermailman2017in “An Even Easier Introduction to CUDA”

   CMU has a few lectures on this open to the public: http://15418.courses.cs.cmu.edu/fall2016/lectures Check out Lecture 7: GPU Architecture and CUDA Programming it starts 16mins in after some review.

   Udacity also has a parallel image processing algorithms w/CUDA course though I haven't done it https://www.udacity.com/course/intro-to-parallel-programming...

6. Mentionsmrlatinos2016in “Radeon Instinct – Optimized Machine and Deep Learning”

   Just speaking from a personal perspective, I took a parallel computing course at my uni this past semester and CUDA was the main platform we worked on (and I'm an undergraduate). Nvidia also has a great Udacity course they offer for free. Unless AMD gets CUDA compatibility working soon, I really don't see how they're going to catch up as far as adoption goes.

Related courses

• Neural Networks and Deep LearningCoursera · 1 recommender
• 15-418 Parallel Computer Architecture and ProgrammingCarnegie Mellon University · 1 recommender
• Algorithms, Part ICoursera · 38 recommenders
• CS61A: Structure and Interpretation of Computer ProgramsUC Berkeley · 31 recommenders
• 6.006 Introduction to AlgorithmsMIT OpenCourseWare · 27 recommenders
• Introduction to Computer Science and Programming in PythonMIT OpenCourseWare · 25 recommenders
• Algorithms: Design and Analysis, Part 1Coursera · 17 recommenders
• Algorithms, Part IICoursera · 11 recommenders