Practical Web Scraping Course in Python, Scrapy and Selenium

The core of Python web scraping in less than 60 minutes + GitHub repo + Selenium, Scrapy real-life use-cases

4.69 (8 reviews)
Udemy
platform
English
language
Data Science
category
135
students
1 hour
content
Jul 2022
last update
$54.99
regular price

What you will learn

How to get data for your content, stock info, crypto exchange reserves, etc.

How to scrape sites with popular frameworks

Advanced techniques like scraping images, pdfs, graphics, etc.

Get more information in less time: save yourself hours of research

Working, tested instrument that'll get you data from 95% of sites

Description

With the vast amount of data available on the internet, it's no wonder that web scraping has become such a popular tool for extracting information. Whether you're looking to gather data for research purposes or collect information from a competitor's website, web scraping can be a valuable skill in your toolkit. And with this practical web scraping course, you'll learn everything you need to know to start extracting data from any website. So if you're ready to start learning web scraping, this is the course for you.


Right now, the "Practical Web Scraping Course" is an ongoing project and therefore it will contain the most recent ways to parse data and would be updated often. You'll also get your answers to the questions you'd have in a short period. Here's the list of all themes that you'd learn within this course eventually:

  • Tracking HTTP requests in practice

  • Basic scraping with BS4 and requests libraries

  • BS4 tools in detail

  • Efficient scraping with Selenium

  • Visual Intro to Selenium tools

  • Dealing with authentication and user sessions

  • Bypassing Captcha

  • Scraping dynamic websites

  • Selenium and pagination

  • Scraping HighCharts.JS

  • Use Heroku to host your spiders

  • Scrapy Introduction

  • Scrapy integration with DB

  • [Items below would be added in the next part of the course]

  • Hosting Scrapy spiders locally

  • Use schedulers to run Scrapy spiders locally

  • Ethical scraping tools

  • Avoid getting banned

  • Scraping images and pdf’s

  • Real-time scraping


With this course you will be able to:

- Save time by learning modern methods of data scraping

- Get information about the most up-to-date scraping tools and techniques

- Avoid being scammed by others selling outdated courses

- Get your money's worth with a complete and comprehensive course


Content

Introduction

Hello and Welcome
How to use the course
Development environment setup
Reading Materials
Last Check Before We Start
[LEARNING TIP] Use captions created for this course

Part 1. Basic Scraping Toolkit

Tracking HTTP requests
Basic scraping with BS4
How to get the same result with find() and select() methods of BS4?
Basic scraping with BS4 Followup
BS4 tools in detail
Efficient scraping with Selenium
Visual Intro to Selenium tools
Pagination
Pagination Followup
Scraping endless pages
Dealing with authentication and user sessions
Bypassing Captcha
Scraping HighCharts.JS plots

Part 2. Scrapy

Scrapy Intro
Basic Scrapy crawler in 100 seconds
Where Scrapy is better than Selenium?
Scrapy with MongoDB

Real Life Use Case #1. Run spider on Heroku

EtherScan API spider. Part #1
JS code for EtherScan Binance tag addresses parsing in DevTools
EtherScan API spider. Part #2
Commands for EtherScan API spider. Part #2

Screenshots

Practical Web Scraping Course in Python, Scrapy and Selenium - Screenshot_01Practical Web Scraping Course in Python, Scrapy and Selenium - Screenshot_02Practical Web Scraping Course in Python, Scrapy and Selenium - Screenshot_03Practical Web Scraping Course in Python, Scrapy and Selenium - Screenshot_04

Reviews

Prajwal
July 10, 2022
Excellent course! This course packs in a lot of valuable information in a compact format. It covers a variety of topics that can help one get started with Web Scraping. The github repo provided is very useful too. Would highly recommend this course to anyone who is interested in Web Scraping and wants to learn in a hands-on way.

Coupons

DateDiscountStatus
6/21/2022100% OFF
expired

Charts

Price

Practical Web Scraping Course in Python, Scrapy and Selenium - Price chart

Rating

Practical Web Scraping Course in Python, Scrapy and Selenium - Ratings chart

Enrollment distribution

Practical Web Scraping Course in Python, Scrapy and Selenium - Distribution chart
4202268
udemy ID
7/24/2021
course created date
6/21/2022
course indexed date
Bot
course submited by