Master Python Web Scraping & Automation using BS4 & Selenium

Complete Web Scraping, Web Crawling and Web Automation Bootcamp using Python 3, Selenium, BeautifulSoup and Chromium

4.35 (214 reviews)
Udemy
platform
English
language
Web Development
category
instructor
37,653
students
3.5 hours
content
Jun 2022
last update
$64.99
regular price

What you will learn

Fundamentals of Web Scraping and Automation

Understand Xpath & CSS Selectors

Working with Spreadsheets and CSV files

Automating Websites using Selenium

Scraping and Crawling Websites using BeautifulSoup

Multi-Threading Web Scraping Operations

Web Scraping Best Practices

Description

Do you want to learn Web Scraping and Automation using Python and tools such as Selenium, BeautifulSoup, and Chromium? If so, Then this is the course for you!

WHAT DOES THIS COURSE FEATURE?

In this course, we’ll use the best tools and techniques available on the Internet to create powerful and efficient web scrapers and bots. Our focus will be towards developing 3 fully-featured python scripts that will solve the following issues respectively.

  1. Scraping Data From An API

  2. Scraping Data From HTML Web Pages

  3. Automating Websites

By the end of this course, you’ll have mastered the skills required to effectively use Selenium, BeautifulSoup, Chromium and Python to build powerful Web Scrapers and Bots.

WHAT TOPICS WILL BE COVERED?

  • Working with Python Requests Module

  • Understanding Request Headers

  • Exporting Data to XLS Files

  • Sending Emails using Python

  • Working with API’s

  • Reading in Data From A CSV File.

  • The fundamentals of Beautiful Soup and LXML

  • Exporting Data to CSV Files.

  • Utilizing Multi-Threading to Speed Up Scraping

  • Navigating HTML Documents

  • Extracting Information From HTML elements such as Tables.

  • The fundamentals of Selenium

  • Automating Web Actions such as Clicks and Navigation

  • Filling Form Data

  • Screen Capturing Web Pages

  • Efficiently using CSS Selectors & XPaths

  • And alot more

WHAT ELSE DOES THIS COURSE OFFER?

Deep, Fine-Grained Learning – This course is jam-packed with information. I made the course that I most wanted to take and as a result, I didn't skimp on the details. You're going to cover more topics and material in greater depth than ever before.

100% Real-World Practice – My goal is to get you writing code as much as possible. And not just any code–we'll be working exclusively on practical tasks that are instrumental in building your own amazing real-world apps.

No-Nonsense, Spot-On Explanations - Every lesson is to the point. I break down what we're making, how we'll be doing it, and what the final product will look like, all on top of helpful and illustrative descriptions to aid your understanding along the way.

I really enjoyed making this course and I think you’ll enjoy taking it just as much.

Looking forward to seeing you taking this course!

Who this course is for:

  • Beginner/Intermediate Python Developers

  • Individuals looking to learn more about Web Scraping and Automation

Content

Introduction

Introduction

Overview & Setup

Creating Python Virtual Enviroment
Understanding HTML Documents
Course Structure & Topics Covered

Python API Scraper

Module Introduction
Creating API Scraping Script Skeleton
Retreving Data From API
Exporting Data To Spreadsheet
Sending Email Using Python and SMTP

Web Scraper

Module Introduction
Creating HTML Scraping Script
Read Product Urls from CSV
Get HTML for URL
Extracting Product Price From HTML
Extracting Product Title From HTML
Extracting Product Rating From HTML
Extracting Product Details From HTML
Writing Data To CSV File

Selenium Web Automation

Module Introduction
Selenium Web Automation Script Demo
Setting up Python Script
Configuring Python Selenium Driver
Setting up Config File
Populating Form Fields using Selenium
Login to Website using Python and Selenium
Navigating to Trello Board
Clicking Add Task Button
Adding Task To To Do List
Screenshot Web Page

Screenshots

Master Python Web Scraping & Automation using BS4 & Selenium - Screenshot_01Master Python Web Scraping & Automation using BS4 & Selenium - Screenshot_02Master Python Web Scraping & Automation using BS4 & Selenium - Screenshot_03Master Python Web Scraping & Automation using BS4 & Selenium - Screenshot_04

Reviews

Joaquin
October 14, 2023
muy buena, explica paso por paso. Ademas de que no se salta ningun detalle de como funciona y para que lo hace
Jean
June 22, 2023
Buena inducción para considerar la preparación del entorno en python y empezar a practicarlo para un proposito en los desarrolllos con el lenguaje python.
Dhanush
April 4, 2023
The Instructor is clearly explaining the things in this course. Really it is happy to learn from him.
Robert
July 31, 2022
Very well put together and informative. The instructor spoke a little too fast for me, but as with all Udemy courses you can change the speeds to suit you.
Grady
July 20, 2022
This course does an excellent job of getting across how to implement various important tools for web scraping. An added bonus is the teaching of working with spreadsheets and email using Python.
Tom
July 14, 2022
The instructor sounds very knowledgable and knows the topics very well. But i can't really say who this course is target for. The features/libraries/components from each project are covered very lightly without much depth. I hope the instructor has plans to expand this course in the future with more advance topics with Selenium and BS4.
Emmanuel
July 7, 2022
This course is good as a refresher if you already have experience with Selenium. If you are a beginner some of the concepts may be hard to understand since there are no in-depth explanations. I was able to learn some new things such as writing to an excel sheet with the data that was being scraped. The formatting of the excel sheet did not come out as intended since some of the product pages are different and may contain more or less information from what is being scraped. I really liked how the scripts were written and each function was maintainable and easy to read. I wish this course would have gone over explicit waits and how to run a bot periodically on a server. Nonetheless, still a good learning experience!
Ken
January 12, 2022
Hussain, this is fantastic course! After going through it, I was able to build a really useful project where i scrapped all my solutions and even README files from codewars! Thank you very much!!
Muhammad
January 11, 2022
Hussain clearly goes the extra mile to make sure you understand the process involved with each lesson. He has personally troubleshot with my issues numerous times to ensure it works. Highly recommend this course if you're serious about learning python webscraping.
Jim
January 9, 2022
Fantastic course so far! I am only completed about 30% of the course, but I can already build my own functional sccrapers. Hussain is so knowledgeable about the subject matter and he is direct in his teaching... He shows you what you need to know and if there are multiple ways, he explains the various ways as well. He doesn't beat around the bush, so you can learn what you need to learn and move on. All in all, this course is excellent value for money.

Coupons

DateDiscountStatus
3/19/2023100% OFF
expired
3/19/2023100% OFF
expired
4/1/2023100% OFF
expired
4/3/2023100% OFF
expired
4/4/2023100% OFF
expired
5/1/2023100% OFF
expired
5/2/2023100% OFF
expired
5/3/2023100% OFF
expired
6/5/2023100% OFF
expired
6/8/2023100% OFF
expired
6/16/2023100% OFF
expired
7/1/2023100% OFF
expired
7/8/2023100% OFF
expired
7/13/2023100% OFF
expired
8/5/2023100% OFF
expired
8/17/2023100% OFF
expired
8/20/2023100% OFF
expired
9/2/2023100% OFF
expired
9/8/2023100% OFF
expired
9/18/2023100% OFF
expired
10/8/2023100% OFF
expired
10/18/2023100% OFF
expired
11/2/2023100% OFF
expired
11/7/2023100% OFF
expired
11/20/2023100% OFF
expired
12/1/2023100% OFF
expired
12/18/2023100% OFF
expired
1/5/2024100% OFF
expired
1/7/2024100% OFF
expired
1/8/2024100% OFF
expired
2/2/2024100% OFF
expired
2/8/2024100% OFF
expired
2/14/2024100% OFF
expired
3/2/2024100% OFF
expired
3/6/2024100% OFF
expired
3/14/2024100% OFF
expired

Charts

Price

Master Python Web Scraping & Automation using BS4 & Selenium - Price chart

Rating

Master Python Web Scraping & Automation using BS4 & Selenium - Ratings chart

Enrollment distribution

Master Python Web Scraping & Automation using BS4 & Selenium - Distribution chart
4476550
udemy ID
1/4/2022
course created date
2/3/2022
course indexed date
Bot
course submited by