Become an expert in web scraping with 4 projects in BS4, Selenium & Scrapy
Welcome to Web Scraping in Python with Beautiful Soup, Selenium, and Scrapy!
The most complete and project-oriented course. In this course, we're going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:
- Amazon Audible
- Football Stats
- Worldometers
- Movie pages
This is the most complete web scraping course in Python and is split into 3 parts: BeautifulSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.
Why did I build the course this way?
Beautiful Soup has a lot of limitations, but it's still useful for a gentle introduction to web scraping. In contrast, if you learn Selenium you will be able to scrape any website, and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.
Who this course is for?
- Anyone who wants to scrape data from any website with Beautiful Soup, Selenium, and Scrapy
- Data Scientists who want to take their skills to the next level
- Web developers looking to obtain new information or automate tasks
- Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task
Course Curriculum
- What is the best web scraping library? BS4 vs Selenium vs Scrapy (3:30)
- Read This Before You Start
- Installing Python and PyCharm (4:57)
- Python Basics for Web Scraping (30:31)
- Web Scraping Cheat Sheet for The Course (Don't skip it)
- HTML for Web Scraping: Tags and Elements (7:49)
- HTML for Web Scraping: Tree Structure (3:52)
- Section Overview (+ Important Note)
- How to Identify Java Script Driven Websites (3:25)
- Installing Selenium and ChromeDriver (2:19)
- Importing Libraries and Creating The Driver (3:37)
- How to Find Elements with Selenium (3:41)
- Clicking on a Button (6:36)
- Extracting Data from a Table (12:26)
- Exporting Data to a CSV File with Pandas (5:14)
- Selecting Elements within a Dropdown (7:41)
- Section Overview
- Scrapy Installation (2:23)
- Setting up Scrapy with Pycharm (2:39)
- Note: How to Show Hidden Folders on Mac (1:07)
- Scrapy's Commands (4:13)
- Creating our First Project and Spider (6:00)
- Scrapy Templates and How to Find Elements with Scrapy (3:21)
- Scrapy's Shell Command (4:08)
- Building a Spider (2:59)
- Getting links listed in a website (6:19)
- Relative vs Absolute Links (5:10)
- Scraping Data from Multiple Links (10:53)
Your Instructor
Hi! My name is Frank Andrade. Probably you've already watched my YouTube tutorials or read my Python guides on Medium. If not, click on my photo, to check them out.
Start Learning Web Scraping Today!
Save Money with a Bundle
Why buy one course when you can get all of them and spend less?
