Megan V.
Before 365:
Medical scientist | Triumvira Ummonologics
After 365:
Director, Translational Medicine and Data Management | KaliVir Immunotherapeutics
See all reviews
Online Course
free
Web Scraping and API Fundamentals in Python
with
Andrew Treadway
and
Nikola Pulev
Master web data extraction with Python: Harness Web Scraping and APIs
13696 students already have enrolled
Skill level:
Basic
Duration:
4 hours
-
Lessons (4 hours)
-
Practice exams (23 minutes)
- Lessons (4 hours)
- Practice exams (23 minutes)
CPE credits:
7
CPE stands for Continuing Professional Education and represents the mandatory credits a wide range of
professionals must earn to maintain their licenses and stay current with regulations and best
practices. One CPE credit typically equals 50 minutes of learning. For more details, visit NASBA's
official website: www.nasbaregistry.org
CPE stands for Continuing Professional Education and represents the mandatory credits a wide range of
professionals must earn to maintain their licenses and stay current with regulations and best
practices. One CPE credit typically equals 50 minutes of learning. For more details, visit NASBA's
official website: www.nasbaregistry.org
Accredited:
certificate
What You Learn
- Master API fundamentals and Python’s requests for web data collection.
- Learn to extract website data using Beautiful Soup and requests-HTML.
- Acquire HTML and CSS basics to support effective web scraping.
- Handle JavaScript-generated content and common roadblocks.
- Scrape third-party data ethically and in compliance with legal standards.
Topics & tools
pythontheoryprogrammingjupyterapisweb scrapinghtmlbeautifulsoupindustry specialization
Your instructor
Tech Lead | Machine Learning Engineer at Meta
Track record
Bringing real-world expertise from leading global companies
Academic background
Master's degree, Computer Science and Machine Learning
Media and recognition
- Organizer and speaker at programming & bioinformatics meetups
- Author of Python finance & data packages yahoo_fin and PyPly
- Published 80+ Python & R tutorials
- Articles featured on R-bloggers, Interactive Brokers, R Weekly
Data Scientist | Course Creator at 365 Data Science | University of Cambridge Physics graduate
Track record
Bringing real-world expertise from leading global companies
Academic background
Bachelor's degree, Natural Sciences, Physics
Media and recognition
- Silver Medal, International Physics Olympiad
- National and international awards in mathematics and physics competitions
Course OVERVIEW
Description
CPE Credits: 7
Field of Study: Information Technology
Delivery Method: QAS Self Study
Delivery Method: QAS Self Study
Web Scraping and API Fundamentals in Python offers an introduction to the techniques of data extraction from the web. In this course, you will learn how to use one of the most powerful tools on the Internet – APIs. We will also discuss in depth how to obtain information directly from websites using the Beautiful Soup Python package. There will be a short HTML crash course for those not familiar with it. Finally, we will introduce the Requests-HTML package in order to extract dynamically generated JavaScript content.
Prerequisites
- Python (version 3.8 or later), pandas library, and a code editor or IDE (e.g., Jupyter Notebook, Spyder, or VS Code)
- Basic familiarity with Python programming is required.
Advanced preparation
Curriculum
55 lessons
47 exercises
3 exams
- 2. Setting Up the Environment2 MinIn this part of the course, we will explain to you how to set up Python 3 and then load up Jupyter. We’ll also show you what the Anaconda Prompt is and how we use it to download and import new modules.
- 3. Working with APIs47 MinHere we will introduce what APIs are and how to use them. In order to do that, we will discuss the popular data exchange format JSON, as well as HTTP requests and the Python library to submit them – ‘requests’. At the end of the section we will show you how to deal with an API that requires a registration.API overview FreeExercise FreeHTTP requests GET and POST requests FreeExercise FreeJSON preferred data exchange format for APIs FreeExercise FreeExchange rates API GETting a JSON response FreeExercise FreeIncorporating parameters in a GET request FreeExercise FreeAdditional API functionalities FreeExercise FreeCreating a simple currency converter FreeiTunes API FreeHomework FreeExercise FreeHomework - 2 FreeiTunes API Structuring and exporting the data FreeExercise FreeGitHub API Pagination FreeExercise FreeEDAMAM API Initial setup and registration FreeExercise FreeEDAMAM API Sending a POST request FreeExercise FreeDownloading files with Requests Free
- 4. HTML overview38 MinWeb Scraping relies on extracting information from the source code of webpages. Thus, a general understanding of HTML is required. This section is a short crash course for those that are not familiar with HTML. It is meant as an intuitive look into the basics, not a comprehensive guide.What is HTML? FreeExercise FreeStructure of HTML FreeExercise FreeSyntax of HTML. Tags FreeExercise FreeTag attributes FreeExercise FreePopular tags FreeExercise FreeCSS and JavaScript FreeExercise FreeCharacter encoding FreeExercise FreeXHTML and code style FreeExercise FreePractice exam Free
- 5. Web Scraping with Beautiful Soup50 MinAfter familiarizing with HTML, we are ready to delve into the Web Scraping itself. We will now introduce the “Beautiful Soup” package and explore its capabilities.Introduction to the Beautiful Soup package FreeWorkflow of Web Scraping FreeExercise FreeSetting up your first scraper FreeSearching and navigating the HTML tree FreeExercise FreeSearching the HTML tree by attributes FreeExercise FreeExtracting data from the HTML tree FreeExtracting text from an HTML tag FreeExercise FreePractical example dealing with links FreeHomework BeautifulSoup Section 1 FreeExtracting data from nested HTML tags FreeScraping multiple pages automatically Free
- 6. Practical project: Scraping Rotten Tomatoes27 MinNow that we’ve seen what Beautiful Soup can do, we will devote this section to practicing our newly formed skills. We are going to obtain information about movies from a ‘Rotten Tomatoes’ rank list.Setting up your scraper FreeExtracting the title and year of each movie FreeHomework BeautifulSoup Secion 2 - Score FreeExtracting the rest of the information FreeHomework BeautifulSoup Secion 2 - Rest FreeDealing with the cast of the movies FreeStoring and exporting the data in a structured form FreePractice exam Free
- 7. Scraping HTML tables7 MinIn this short section, we will discuss an easy way to scrape HTML tables.
- 8. Common roadblocks when scraping13 MinAlthough we have done a decent amount of scraping so far in the course, this is one of those topics that can depend very much so on the website we choose. Different websites present specific problems. Thus, in this section, we will discuss what are the most common problems that you will have to deal with and give you solutions and workarounds.
- 9. The requests-html package26 MinHere, we will introduce another Web Scraping package – ‘Requests-HTML’. We are doing it because it has one big advantage over Beautiful Soup – the ability to execute JavaScript. Thus, this allows us to extract dynamically generated content which is exactly what we will do.
- 10. Course exam50 Min
Free preview
1.1 What does the course cover
4 min
1.2 What is Web Scraping
3 min
1.4 Ethics of Scraping
3 min
2.1 Setting up the Environment
1 min
2.2 Installing the Necessary Packages
1 min
3.1 API overview
3 min
#1 most reviewed
AI and data learning platform on Trustpilot.
94%
of AI and data science graduates
successfully change
or advance their careers.
9 in 10
people walk away career-ready
with practical data and AI skills.
ACCREDITED certificates
Craft a resume and LinkedIn profile you’re proud of—featuring certificates recognized by leading global
institutions.
Earn CPE-accredited credentials that showcase your dedication, growth, and essential skills—the qualities
employers value most.
How it WORKS
Student REVIEWS
