Udemy

Platform

English

Language

Data Science

Category

Learn BERT - most powerful NLP algorithm by Google

Understand and apply Google's game-changing NLP algorithm to real-world tasks. Build 2 NLP applications.

4.32 (763 reviews)

Students

5.5 hours

Content

Sep 2021

Last Update
Regular Price


What you will learn

Understand the history about BERT and why it changed NLP more than any algorithm in the recent years

Understand how BERT is different from other standard algorithm and is closer to how humans process languages

Use the tokenizing tools provided with BERT to preprocess text data efficiently

Use the BERT layer as a embedding to plug it to your own NLP model

Use BERT as a pre-trained model and then fine tune it to get the most out of it

Explore the Github project from the Google research team to get the tools we need

Get models available on Tensorflow Hub, the platform where you can get already trained models

Clean text data

Create datasets for AI from those data

Use Google Colab and Tensorflow 2.0 for your AI implementations

Create customs layers and models in TF 2.0 for specific NLP tasks


Description

Dive deep into the BERT intuition and applications:


  • Suitable for everyone: We will dive into the history of BERT from its origins, detailing any concept so that anyone can follow and finish the course mastering this state-of-the-art NLP algorithm even if you are new to the subject.

  • Powerful and disruptive: Learn the concepts behind a new BERT, getting rid of RNNs, CNNs and other heavy deep learning models to implement a more intuitive way to process language that will suit a wide range of NLP purposes, including yours!

  • User-friendly and efficient: We’ve designed the course using the latest technologies, using Tensorflow 2.0 and Google Colab, assuring that you won’t have any local machine/software version/compatibility issues and that you are using the most up-to-date tools.


Screenshots

Learn BERT - most powerful NLP algorithm by Google
Learn BERT - most powerful NLP algorithm by Google
Learn BERT - most powerful NLP algorithm by Google
Learn BERT - most powerful NLP algorithm by Google

Content

Introduction

Welcome to the course

Course curriculum, Colab toolkit and data links

BERT - Intuition

What is BERT?

Embedding

General Idea

Old fashioned seq2seq

Transformer general understanding

Attention

Architecture

Pre-training

Application: using BERT's tokenizer

CNN explanation

Intro

Dependencies

Loading Files

Cleaning Data

Tokenization

Dataset Creation

Model Building

Training

Evaluation

Application: using BERT as an embedder

Inputs

Model Results

Application: fine-tuning BERT to create a question answering system

Intro

Dependencies

Data Preprocessing

Squad Layer

Whole Model

Compile AI

Training

Evaluation Preparation

Evaluation Creation

Evaluation Result

Conclusion

Summary: how to use BERT


Reviews

D
Derrick17 September 2020

Great course. It covers all the basics with enough detail to actually use BERT at the end. Well worth the time.

Y
Yeb26 August 2020

The slides in the theoretical part are just a handful of images in a video of ~20 minutes, without any example words or vectors to indicate what goes where, which makes it harder to follow than necessary.

A
Anand26 August 2020

Very Informative Course. Covering the Basics of BERT until the good level of BERT applications. Thanks

P
Porus25 August 2020

Martin teaches this course in a wonderful way. Understood the basics of BERT along with some of its applications.

M
Mike10 August 2020

The explanations are quite thorough. Going through the code is great, too, but there is a little too much time spent on the "easy stuff" (like using pip, etc.)

J
Jakob4 August 2020

Ovarall this course is very well put together and step by step increases the understanding of how to apply BERT to tackle different problems. Absolutely my preferred way to learn so thank you for that! One thing to note is that the third application is very related to SQUAD and it would be great to have a session on how to transfer this knowledge to constructing a custom Q/A application from scratch as one fear to learn too much specific to SQUAD. I would also have preferred a session on how to fine tune the training for the sentiment classification model as well just to have seen it. That being said I can highly recommend this course to anyone ready to start digging deeper into BERT

G
Gahobain27 July 2020

would like to get bit more details on BERT customization. At least documentation pointers from Google.

M
MENG-HSIEN10 July 2020

I like this course! I appreciate the level of detail that instructor shared to the coding section and his insight and experience sharing. Sometimes a couple sentence of explanation save me quite some time of web search. I like the project example with actual hold-hand coding. I admit initially it's harder to follow since I am new to this area, but it gets easier as the 3 projects are related to each other and can carry on to the next project. I have a solid learning feeling. The only thing is if the transcript could be real but not auto-generated would help me to understand some word or terminology easier. This is one of a few courses I've actually completed end to end.

M
Marlon30 June 2020

There are topics that need to be explain better, because it's a lot a code but at the end, I'm not sure if I can apply this to a personal project. All courses from SDC have had an intuation part with a presentation deck that helps to understand better.

M
Matthew9 May 2020

So far, just reviewing stuff I already know. BTW, I've seen a few spelling / typing errors in the slides. Update: the instructions in the course to get the data for the first practical section didn't work. I also didn't see any link to the notebook (I expected to have a template).

P
Prabhu5 February 2020

The course explains about the BERT overall on an average level. The application part of the BERT is quite good but the theory part of the BERT could be more mathematical and relevant research papers should have been referenced for further exploration.

Q
Quang2 January 2020

I find it rather ambiguous when the instructor mention Shape and dimensions of the layers in the network. I know he did mentioned it in the first part but still, the learner has to go back and find the diagram and it really affects the flow. So I would suggest while constructing the network, he could add a diagram to illustrate the dimension of each layer.

F
Freddie26 December 2019

I find it hard to follow, its the French accent but also a lot of theory which requires a lot of concentration and could benefit from shorter lectures and more samples to explain.

I
Ilya22 December 2019

I was hoping to learn everything about using BERT, but I haven't. The most important things (how to prepare data and what is returned by BERT) took just a few minutes without ANY visuals. Don't show your typing, show a well-commented code and tell why did you write this and that. And don't use SQuAD, your students will have their own tasks!

M
Meynardo19 December 2019

The course is excellent as it details the state-of-the-art BERT algorithm on SQUAD 1.1. It would have been REALLY AWESOME if the course also included a further section on the newer SQUAD 2.0, and perhaps (please, PLEASE!) on the more general and more interesting open-domain question answering topic. Kudos to the author and the team!!!


Coupons

DateDiscountStatus
6/28/202092% OFFExpired
3/13/202192% OFFExpired

2518074

Udemy ID

8/20/2019

Course created date

1/7/2020

Course Indexed date
Bot
Course Submitted by