Megan V.
Before 365:
Medical scientist | Triumvira Ummonologics
After 365:
Director, Translational Medicine and Data Management | KaliVir Immunotherapeutics
See all reviews
Online Course
Web Scraping and API Fundamentals in Python
with
Andrew Treadway
and
Nikola Pulev
Master web data extraction with Python: Harness Web Scraping and APIs
14,076 students already enrolled
Skill level:
Basic
Duration:
4 hours
-
Lessons (4 hours)
-
Practice exams (23 minutes)
- Lessons (4 hours)
- Practice exams (23 minutes)
CPE credits:
7
CPE stands for Continuing Professional Education and represents the mandatory credits a wide range of
professionals must earn to maintain their licenses and stay current with regulations and best
practices. One CPE credit typically equals 50 minutes of learning. For more details, visit NASBA's
official website: www.nasbaregistry.org
CPE stands for Continuing Professional Education and represents the mandatory credits a wide range of
professionals must earn to maintain their licenses and stay current with regulations and best
practices. One CPE credit typically equals 50 minutes of learning. For more details, visit NASBA's
official website: www.nasbaregistry.org
Accredited
certificate
What you learn
- Master API fundamentals and Python’s requests for web data collection.
- Learn to extract website data using Beautiful Soup and requests-HTML.
- Acquire HTML and CSS basics to support effective web scraping.
- Handle JavaScript-generated content and common roadblocks.
- Scrape third-party data ethically and in compliance with legal standards.
Topics & tools
PythonTheoryProgrammingJupyterAPIsWeb ScrapingHTMLBeautifulsoupIndustry Specialization
Your instructor
Tech Lead | Machine Learning Engineer at Meta
Track record
Bringing real-world expertise from leading global companies
Academic background
Master's degree, Computer Science and Machine Learning
Media and recognition
- Organizer and speaker at programming & bioinformatics meetups
- Author of Python finance & data packages yahoo_fin and PyPly
- Published 80+ Python & R tutorials
- Articles featured on R-bloggers, Interactive Brokers, R Weekly
Data Scientist | Course Creator at 365 Data Science | University of Cambridge Physics graduate
Track record
Bringing real-world expertise from leading global companies
Academic background
Bachelor's degree, Natural Sciences, Physics
Media and recognition
- Silver Medal, International Physics Olympiad
- National and international awards in mathematics and physics competitions
Course OVERVIEW
Description
CPE Credits: 7
Field of Study: Information Technology
Delivery Method: QAS Self Study
Delivery Method: QAS Self Study
Web Scraping and API Fundamentals in Python offers an introduction to the techniques of data extraction from the web. In this course, you will learn how to use one of the most powerful tools on the Internet – APIs. We will also discuss in depth how to obtain information directly from websites using the Beautiful Soup Python package. There will be a short HTML crash course for those not familiar with it. Finally, we will introduce the Requests-HTML package in order to extract dynamically generated JavaScript content.
Prerequisites
- Python (version 3.8 or later), pandas library, and a code editor or IDE (e.g., Jupyter Notebook, Spyder, or VS Code)
- Basic familiarity with Python programming is required.
Advanced preparation
Curriculum
55 lessons
47 exercises
3 exams
- 2. Setting Up the Environment2 minIn this part of the course, we will explain to you how to set up Python 3 and then load up Jupyter. We’ll also show you what the Anaconda Prompt is and how we use it to download and import new modules.2 minIn this part of the course, we will explain to you how to set up Python 3 and then load up Jupyter. We’ll also show you what the Anaconda Prompt is and how we use it to download and import new modules.Setting up the Environment FreeInstalling the Necessary Packages Free
- 3. Working with APIs47 minHere we will introduce what APIs are and how to use them. In order to do that, we will discuss the popular data exchange format JSON, as well as HTTP requests and the Python library to submit them – ‘requests’. At the end of the section we will show you how to deal with an API that requires a registration.47 minHere we will introduce what APIs are and how to use them. In order to do that, we will discuss the popular data exchange format JSON, as well as HTTP requests and the Python library to submit them – ‘requests’. At the end of the section we will show you how to deal with an API that requires a registration.API overview FreeExercise FreeHTTP requests GET and POST requests FreeExercise FreeJSON preferred data exchange format for APIs FreeExercise FreeExchange rates API GETting a JSON response FreeExercise FreeIncorporating parameters in a GET request FreeExercise FreeAdditional API functionalities FreeExercise FreeCreating a simple currency converter FreeiTunes API FreeHomework FreeExercise FreeHomework - 2 FreeiTunes API Structuring and exporting the data FreeExercise FreeGitHub API Pagination FreeExercise FreeEDAMAM API Initial setup and registration FreeExercise FreeEDAMAM API Sending a POST request FreeExercise FreeDownloading files with Requests Free
- 4. HTML overview38 minWeb Scraping relies on extracting information from the source code of webpages. Thus, a general understanding of HTML is required. This section is a short crash course for those that are not familiar with HTML. It is meant as an intuitive look into the basics, not a comprehensive guide.38 minWeb Scraping relies on extracting information from the source code of webpages. Thus, a general understanding of HTML is required. This section is a short crash course for those that are not familiar with HTML. It is meant as an intuitive look into the basics, not a comprehensive guide.What is HTML?ExerciseStructure of HTMLExerciseSyntax of HTML. TagsExerciseTag attributesExercisePopular tagsExerciseCSS and JavaScriptExerciseCharacter encodingExerciseXHTML and code styleExercisePractice exam
- 5. Web Scraping with Beautiful Soup50 minAfter familiarizing with HTML, we are ready to delve into the Web Scraping itself. We will now introduce the “Beautiful Soup” package and explore its capabilities.50 minAfter familiarizing with HTML, we are ready to delve into the Web Scraping itself. We will now introduce the “Beautiful Soup” package and explore its capabilities.Introduction to the Beautiful Soup packageWorkflow of Web ScrapingExerciseSetting up your first scraperSearching and navigating the HTML treeExerciseSearching the HTML tree by attributesExerciseExtracting data from the HTML treeExtracting text from an HTML tagExercisePractical example dealing with linksHomework BeautifulSoup Section 1Extracting data from nested HTML tagsScraping multiple pages automatically
- 6. Practical project: Scraping Rotten Tomatoes27 minNow that we’ve seen what Beautiful Soup can do, we will devote this section to practicing our newly formed skills. We are going to obtain information about movies from a ‘Rotten Tomatoes’ rank list.27 minNow that we’ve seen what Beautiful Soup can do, we will devote this section to practicing our newly formed skills. We are going to obtain information about movies from a ‘Rotten Tomatoes’ rank list.Setting up your scraperExtracting the title and year of each movieHomework BeautifulSoup Secion 2 - ScoreExtracting the rest of the informationHomework BeautifulSoup Secion 2 - RestDealing with the cast of the moviesStoring and exporting the data in a structured formPractice exam
- 7. Scraping HTML tables7 minIn this short section, we will discuss an easy way to scrape HTML tables.7 minIn this short section, we will discuss an easy way to scrape HTML tables.Scraping HTML tables with the help of PandasScraping Steam
- 8. Common roadblocks when scraping13 minAlthough we have done a decent amount of scraping so far in the course, this is one of those topics that can depend very much so on the website we choose. Different websites present specific problems. Thus, in this section, we will discuss what are the most common problems that you will have to deal with and give you solutions and workarounds.13 minAlthough we have done a decent amount of scraping so far in the course, this is one of those topics that can depend very much so on the website we choose. Different websites present specific problems. Thus, in this section, we will discuss what are the most common problems that you will have to deal with and give you solutions and workarounds.Common roadblocks when Web ScrapingExercise
- 9. The requests-html package26 minHere, we will introduce another Web Scraping package – ‘Requests-HTML’. We are doing it because it has one big advantage over Beautiful Soup – the ability to execute JavaScript. Thus, this allows us to extract dynamically generated content which is exactly what we will do.26 minHere, we will introduce another Web Scraping package – ‘Requests-HTML’. We are doing it because it has one big advantage over Beautiful Soup – the ability to execute JavaScript. Thus, this allows us to extract dynamically generated content which is exactly what we will do.Introduction to the requests-html packageExploring the capabilities of requests-html for Web ScrapingSearching for textCSS selectorsExerciseScraping SoundCloudScraping JavaScript
- 10. Course exam50 min50 minCourse exam
Free lessons
1.1 What does the course cover
4 min
1.2 What is Web Scraping
3 min
1.4 Ethics of Scraping
3 min
2.1 Setting up the Environment
1 min
2.2 Installing the Necessary Packages
1 min
3.1 API overview
3 min
#1 most reviewed
AI and data learning platform on Trustpilot.
94%
of AI and data science graduates
successfully change
or advance their careers.
9 in 10
people walk away career-ready
with practical data and AI skills.
ACCREDITED certificates
Craft a resume and LinkedIn profile you’re proud of—featuring certificates recognized by leading global
institutions.
Earn CPE-accredited credentials that showcase your dedication, growth, and essential skills—the qualities
employers value most.
Certificates are included with the Self-study learning plan.
How it WORKS
Student REVIEWS
