Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel

From Beginner to Advanced | 4 Hands-On Projects

4.65 (101 reviews)
Udemy
platform
English
language
Other
category
16,669
students
4.5 hours
content
Nov 2021
last update
$29.99
regular price

What you will learn

web scraping

data extraction

data mining

create your own dataset

output data in Excel

output your dataframe in PostgreSQL

run SQL commands on your dataframe

Description

In this course the students will get to know how to scrape data from the API of a website (if available). We start with the fundamentals and the beginner level project. After that, two different projects will be covered, followed by the advanced project. After scraping data of wach project, the results will be stored inside an Excel file. Within the advanced level project we will create two dofferent datasets with 5000 results each. The goal is to merge both dataframes (total: 10000 results), save it in Excel and output the data in the PostgreSQL database and run SQL commands on our own data.

The requirement for this course is basic knowledge of Python Programming. Since we will not cover very difficult Python topics you do not have to be a professional. The most important characteristic is that you are curious about Web Scraping and Data Mining. You should be ready to invest time in gaining the knowledge which is taught in this course.

After this course you will have the knowledge and the experience to scrape your own data and create your own dataset. With the help of the course resources you will always have documents you can refer to. If you have a question or if a concept just does not make sense to you, you can ask your questions anytime inside the Q&A - Forum. Either the instructor or other students will answer your question. Thanks to the community you will never have the feeling to learn alone by yourself.


Disclaimer : I teach web scraping as a tutor for educational purposes. That's it.

The first rule of scraping the web is: do not harm a certain website. The second rule of web crawling is: do NOT harm a certain website.

Screenshots

Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Screenshot_01Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Screenshot_02Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Screenshot_03Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Screenshot_04

Content

Introduction

Course Overview & Introduction
Addition to Course Overview
Before you start

Fundamentals & Project # 1 - Beginner Level

Install necessary libraries
Fundamentals & Project # 1 (Part 1/2)
Fundamentals & Project # 1 (Part 2/2)

Project # 2 - Intermediate Level

Project Overview & Understanding the website's API
Find the necessary Data
Extract Data from Single Page
Extract Data from Multiple Pages + Excel

Project # 3 - BONUS SECTION -Infinite Scroll Website - Intemediate Level

Project Overview & Requests
Find your Data
Extract Data from One Page
Extract Data from 10 Pages

Project #4 - Advanced Level Project + PostgreSQL

Project Overview
New York Data - Set Up & Python Request
New York Data - Find your Data
New York Data - Extract Data from One Page
New York Data - Extract 5000 results
San Francisco Data - Extract 5000 results
Combine Dataframes & Excel
Install PostgreSQL
Connect Jupyter Notebook with PostgreSQL & Run SQL - Commands

Reviews

Pearl
June 5, 2022
It went better than what i expected, gained some valuable knowledge on how to scrape data from webpages
Sagar
May 5, 2022
This was such an extraordinary course. Straight to the point. Full hands-on. I mainly took the course to learn about Network traffic of a website i.e. getting the endpoints to scrape the data from. The course fully satisfied my expectations. I was even able to apply the knowledge gained from this course at work. I fully recommend this course to anyone who wants to learn scraping data from APIs.
Marta
August 30, 2021
Fue una buena elección, en el aspecto de la obtención de información de APIs utilizando requests, json, diccionarios etc muy bien... Me hubiese gustado más variedad entre los ejemplos de webs, y un poco más de explicación en el funcionamiento interno de herramientas como engine (sqlalchemy)
Alex
August 18, 2021
Fantastic course that gave me many new insights on options for webscraping. Very clear instructions and well paced. Only minor suggestion for improvement would be to paste blocks of program sections in section 5, since I found myself skipping some parts of the videos watching the instructor typing the same code over and over again. Or even better: introduce the use of functions in stead of in-line code. This is better programming practice and reduces the use of repetitive code. Particularly in an "advanced level" section)
Michael
August 13, 2021
In Combination with the Postgres(SQL) section this course is awesome- it shows how we as a student can output files in Databases and use SQL on our own scraped data!
Kilian
August 13, 2021
better than expected. as a beginner i did not have trouble with following along. each concept is explained in detail.
konstantina
August 13, 2021
Excellent course and a This teacher puts in effort to prepare his lecture slides (they are pretty well prepared and comprehensive). His lectures are fairly interesting and engaging
Madjec
August 13, 2021
So far very good course. Very hard to find somebody on the Internet who explains complex stuff with such a patience and clarity
Mohamed
August 11, 2021
I think the instructor is well experienced in web Scraping. I hope he will make more detailed and advanced courses to master this interesting skill " Web Scraping ".
James
August 11, 2021
better than expected. as a data scientist i found it hard to find good and well strctured web scraping courses, especially when it comes to scrape the websites hidden api. alex (instructor) is just brilliant for this job! thanks!
Signat
August 11, 2021
well structured, easy to follow along! this guy speaks very clearly and explains all concepts in detail
Nahil
August 9, 2021
This course is had the answers to my questions. I knew API Scraping is very powerful and an alternative to Selenium and BS4 Scraping. Nice strctured, the instructor knows what he is saying!
Dennis
August 7, 2021
The course is really well structured and well built. Contents are accordingly easy for me to understand. He is a great tutor. Thanks Alexander, you helped me a lot!!
Aleksander
August 6, 2021
As expected, the course was once again professional, understandably well structured. I could easily follow the topics covered. The knowledge was imparted at a reasonable pace. 5/5 Stars!
Alexander
August 6, 2021
Very well structured course with lots of high quality input. I really liked the additional advanced and bonus section. 10/10

Charts

Price

Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Price chart

Rating

Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Ratings chart

Enrollment distribution

Web Scraping APIs for Data Science 2021 | PostgreSQL+Excel - Distribution chart

Coupons

DateDiscountStatus
8/11/2021100% OFF
expired
4224706
udemy ID
8/5/2021
course created date
8/8/2021
course indexed date
Bot
course submited by