CUDA programming Masterclass with C++

Learn parallel programming on GPU's with CUDA from basic concepts to advance algorithm implementations.

4.39 (1498 reviews)

Udemy

platform

English

language

Programming Languages

What you will learn

All the basic knowladge about CUDA programming

Ability to desing and implement optimized parallel algorithms

Basic work flow of parallel algorithm design

Advance CUDA concepts

Why take this course?

This course is all about CUDA programming. We will start our discussion by looking at basic concepts including CUDA programming model, execution model, and memory model. Then we will show you how to implement advance algorithms using CUDA. CUDA programming is all about performance. So through out this course you will learn multiple optimization techniques and how to use those to implement algorithms. Also we will extensively discuss profiling techniques and some of the tools including nvprof, nvvp, CUDA Memcheck, CUDA-GDB tools in the CUDA toolkit. This course contains following sections.

Introduction to CUDA programming and CUDA programming model

CUDA Execution model

CUDA memory model-Global memory

CUDA memory model-Shared and Constant memory

CUDA streams

Tuning CUDA instruction level primitives

Algorithm implementation with CUDA

CUDA tools

With this course we include lots of programming exercises and quizzes as well. Answering all those will help you to digest the concepts we discuss here.

This course is the first course of the CUDA master class series we are current working on. So the knowledge you gain here is essential of following those course as well.

Screenshots

CUDA programming Masterclass with C++ - Screenshot_01

CUDA programming Masterclass with C++ - Screenshot_02

CUDA programming Masterclass with C++ - Screenshot_03

CUDA programming Masterclass with C++ - Screenshot_04

Reviews

Josh

September 2, 2023

The course example code is completely windows-centric, where as CUDA programming for building Deep Learning framework internals is targetted towards Linux accent is hard to follow at 2x content more or less matches the Wrox proffesional CUDA programming book

Phuoc-Hoan

July 30, 2023

All of the sections except section 7 are good. For Section 7, I don't understand what is going on or what are the applications for a parallel scan algorithm. Also in Section 7, it seems incomplete or as if parts of the lessons in Section 7 are deleted. For example, "Parallel Compact Algorithm" clip in Section 7, seems to be just thrown in there with no context and I was just left off at how the CSR format works, but I was never shown the implementation of it at all.

Raju

May 1, 2023

This course is very useful for me becouse ,i am a student of Parallel Pragramming. with the help of this course i have learned many thinks like profiling , memory management, offloading and about CPU /GPU etc. clearly.

Michael

March 14, 2023

Information is mostly here but I cannot understand what the instructor is saying. Have to rely on Captions and slides.

Mohammad

January 9, 2023

It would be best if you let students know why the thing they are learning is necessary. For example you go on and on about GID, but you do not clarify why this is important. Another thing you dive into grids and thread blocks and you explain what they are. but It is not explained why it is important. How does this fit into an application? You need to make all of this clear before diving into detail. Otherwise, it's just boring and tedious detail. Basically, I have to trust that I am sitting through all of these detail and somehow at some point it will start to make sense. Why should I waist so much time listening to detail without any context?

Marek

January 6, 2023

This course is based on outdated CUDA. Instructor says it works with all version of Visual Studio after version 2015. It does not. Very difficult to understand what the instructor is saying.

MohammadHossein

January 5, 2023

Really good explanations for both understanding how to code as well as understanding how to tune performance based on the underlying hardware

Nereida

January 5, 2023

I think it would be necessary to add notes or guides to update the content to the newest versions of both CUDA and Visual Studio, since a lot of time is lost at the beginning of the course to be able to tune the computer. Otherwise, the teacher's explanation is very clear, and the subtitles help a lot when you are not an English speaker like me.

Arnon

January 2, 2023

The visual aids in the presentation are fantastic! They are exactly what is missing from most other treatments of CUDA programming.

James

December 28, 2022

the first 90% of the course was great... the last section on image processing was not of the same caliber and wasn't in the same vain as the rest of the course and had a different instructor... it didn't have any useful content related to cuda programming. I was hoping the last section would have provided AES, and ECDSA and real world GPGPU samples....

Atul

December 25, 2022

Yes, the accent is a bit thick but I could understand the words with subs perfectly. The course content is built from the ground up to very advanced topics, and gives you a great understanding. Honestly, it may be a little fast paced in my opinion. I had to spend many more minutes on videos going back and reviewing trying to get my code in order, etc. One important thing to note is that this course uses a profiling tool called nvprof which is NO LONGER SUPPORTED BY CUDA NEWER VERSIONS. This means it would be much more useful to try one of NVIDIAs self paced courses which uses the new system, NSIGHT, which is what I plan to do now.

Christos

October 30, 2022

The language barrier made it hard to follow, so I dropped the course even before completing the Section 1. Also, the slides were poorly written.

Sachin

August 6, 2022

Had a great experience! Course really dives deep into CUDA fundamentals, including the theory, and then considers exercises where we can write CUDA functions to execute parallel programming in multiple scenarios. I would have loved to see more assignments though, so I could challenge myself. Also, the image processing section is still under construction, so it will be exciting to see how we can use CUDA in image processing too.

Melissa

May 19, 2022

Great content. Great teaching. Great source code. Some typos in the slides. If those were fixed, it would look more professional and I would upgrade my rating to a 5 star.

Vesa

January 8, 2021

After using CUDA in my my parallel computing projects its now time to get some learning around the topic.

Charts

Price

Rating

Enrollment distribution

CUDA programming Masterclass with C++ - Distribution chart