MATLAB Parallel programming on GPUs, Cores and CPUs

With practical examples on every parallel programming concept including training NN and deep learning model

4.20 (13 reviews)
Udemy
platform
English
language
Programming Languages
category
instructor
MATLAB Parallel programming on GPUs, Cores and CPUs
61
students
3.5 hours
content
Jan 2022
last update
$44.99
regular price

What you will learn

Run Deep learning models in parallel on GPUs

Learn the difference between cores, CPUs and GPUs

Learn the concept of multi-threading in MATLAB with examples

Learn the concept of multi-workers in MATLAB with examples

measuring the performance of each parallel computing code

Learn how to convert your code to parallel computing to increase the performance

Run MATLAB files and functions in the background

Using GPUs to execute and Run MATLAB functions (Excellent performance)

Description

This course helps students, researchers, and anyone using the MATLAB decrease the execution time they take to execute a program

All computers today and the laptops have multi-cores and GPUs. But not all users use the to run or execute the programs in parallel.

The purpose of the course is to fill this gap. Is to teach you with practical examples how to use all resources on your computer and also how to monitor them.

The course is divided into many sections:

  1. The first is an introduction to the hardware of the CPUs, cores, and GPUs. It is better to understand the basic components of these items to be able to get the best utilization when you use them.

  2. The second section is explaining two concepts. The multi-threading and the multi-workers. The first is a built-in mechanism to run some functions in parallel using many cores but we can't control the number of cores and the way that the functions execute. The second one (multi-workers) is used to run any function on multiple cores but here we can control the number of cores to optimize the program execution. Also, I explained some examples and measured the performance parameters to differentiate between the two concepts.

  3. The third section is the GPU section. In the section, I explained how to run any function on the GPUs to make use of the hundred or thousands of cores that the GPUs have. There are some notations to get the best results and I explained all of these notations with examples.

  4. Deep learning and neural networks: in this section, you will learn how to train any neural network in parallel on GPUs or multi-cores. And also how to run the training process in the background in order to be able to use MATLAB while it is running.

Content

Introduction

The concept of cores, CPUs and GPUs (important)
The difference between the cores and the logical processors

Multi-threading and Multi-cores with practical examples

Practical examples on the multi-threading concept
Practical examples on the multi-workers concept
How to control the number of cores that execute your code?(practical examples)
4 mistakes when using parfor loop (be carful about them)
Nested parfor loops
nested-loops: Calculating the amount of data sent to each core
Functions in parfor loop
Reduction variables (independence) in parfor loop
displaying values inside the parfor loop
Single instruction multiple data (SPMD)
Run MATLAB functions in background using parfeval
Run MATLAB files in background using batch jobs

GPU parallel programming in MATLAB

Check if your GPU supports parallel computing with MATLAB
Read the GP information in MATLAB
Running MATLAB functions on GPUs
Important Notations to run functions on GPUs (Sharpen an image)
Running codes on multiple GPUs

Run Deep learning and Neural network GPUS (parallel)

Train the neural networks in parallel using GPUS in detail
Using multi-GPUs for training the neural networks
Training deep learning model in parallel using GPUs
Train deep NN in the background in parallel

Reviews

Berk
October 15, 2022
Needs more GPU implementations. What about nested loops in GPU? I don't know how to do it. Also, no content on GPU implementation of classes and functions.

Charts

Price

MATLAB Parallel programming on GPUs, Cores and CPUs - Price chart

Rating

MATLAB Parallel programming on GPUs, Cores and CPUs - Ratings chart

Enrollment distribution

MATLAB Parallel programming on GPUs, Cores and CPUs - Distribution chart
4462086
udemy ID
12/26/2021
course created date
2/3/2022
course indexed date
Bot
course submited by