4.6 - Web Scraping Basics
Enroll to start learning
You’ve not yet enrolled in this course. Please enroll for free to listen to audio lessons, classroom podcasts and take practice test.
Practice Questions
Test your understanding with targeted questions
What library can you use to send HTTP requests in Python?
💡 Hint: Think of the name of the library that sounds like asking for something.
What does BeautifulSoup help you do?
💡 Hint: It’s named after something you might find in a kitchen.
4 more questions available
Interactive Quizzes
Quick quizzes to reinforce your learning
What is web scraping?
💡 Hint: Think about when you don’t have an API.
The robots.txt file governs what?
💡 Hint: Consider it like rules for a playground.
Get performance evaluation
Challenge Problems
Push your limits with advanced challenges
You need to extract all product prices from an e-commerce site. Write a Python function that takes a URL as input and returns a list of prices.
💡 Hint: Identify the right HTML tags and classes where prices are stored.
Discuss how you can handle cases when a website denies your scraping request (like implementing captchas). Share potential strategies.
💡 Hint: Think about common web defenses against bots.
Get performance evaluation
Reference links
Supplementary resources to enhance your learning experience.