Web Scraping and API Fundamentals in Python

Curriculum

• Introduction to the course Free

  3 Lessons 10 Min

  In this section, you will learn about the importance of data visualization, as well as some theoretical foundations for creating charts. We introduce popular frameworks for choosing an appropriate visualization for your data, discuss color theory, and show different approaches to selecting the colors for your graphic.

  What does the course cover Free What is Web Scraping Free Ethics of Scraping Free
• Setting Up the Environment Free

  3 Lessons 4 Min

  Here, we set up different environments for the course. First, we will guide you through the installation process for Tableau. Then, you will get familiar with the step-by-step process of installing Anaconda and Jupyter and an introductory tour of the Jupyter Dashboard for Python. Finally, you’ll learn how to install R and R studio, explore the latter’s main features and learn how to customize its appearance.

  Setting up the Environment Free Installing the Necessary Packages Free API overview Free
• Working with APIs Free

  12 Lessons 41 Min

  We dive straight into visualization with the bar chart! We will take a look at a data set for second-hand car advertisements and use it to create a bar chart in Excel, Tableau, Python, and R. We’ll also lift the curtain on the key elements to making an outstanding bar chart.

  HTTP requests GET and POST requests Free JSON preferred data exchange format for APIs Free Exchange rates API GETting a JSON response Free Incorporating parameters in a GET request Free Additional API functionalities Free Creating a simple currency converter Free iTunes API Free iTunes API Structuring and exporting the data Free GitHub API Pagination Free EDAMAM API Initial setup and registration Free EDAMAM API Sending a POST request Free Downloading files with Requests Free
• HTML overview

  8 Lessons 38 Min

  In this section, we explore pie charts, which, despite criticism, are among the most popular visualizations. You will learn how to create a pie chart of engine fuel types in Excel, Tableau, Python, and R, and discover what to avoid when making a pie chart.

  What is HTML? Structure of HTML Syntax of HTML. Tags Tag attributes Popular tags CSS and JavaScript Character encoding XHTML and code style
• Web Scraping with Beautiful Soup

  10 Lessons 49 Min

  Here, you will create your own stacked area chart. Once again, our data follows the automobile theme with one additional element - time series, as the chart follows the popularity of different engine fuel types across the years.

  Introduction to the Beautiful Soup package Workflow of Web Scraping Setting up your first scraper Searching and navigating the HTML tree Searching the HTML tree by attributes Extracting data from the HTML tree Extracting text from an HTML tag Practical example dealing with links Extracting data from nested HTML tags Scraping multiple pages automatically
• Practical project: Scraping Rotten Tomatoes

  5 Lessons 25 Min

  In this section, we continue discussing time series data. We will turn our attention to the financial world and explore the stock market returns for two major indices: S&P 500 and FTSE 100. In conclusion, you’ll find out the advantages of using a line chart and what you should be wary of when creating one.

  Setting up your scraper Extracting the title and year of each movie Extracting the rest of the information Dealing with the cast of the movies Storing and exporting the data in a structured form
• Scraping HTML tables

  1 Lesson 5 Min

  This section centers around the histogram – an integral part of the data analysis process. We will create a histogram of the price of California's real estate. Here, we devote an extra lecture and explore how to choose the right number of bins for your histogram.

  Scraping HTML tables with the help of Pandas
• Common roadblocks when scraping

  1 Lesson 13 Min

  We’ll explore a combination chart of a scatter and a regression line by using marketing data and a regression line to quantify the relationship between a company’s advertising budget and its sales. You will learn how to create a regression scatter in Excel, Tableau, Python, and R, and discover different types of relationships between features in data. the model residuals can be beneficial in model selection.

  Common roadblocks when Web Scraping
• The requests-html package

  5 Lessons 25 Min

  Here, we will introduce another Web Scraping package – ‘Requests-HTML’. We are doing it because it has one big advantage over Beautiful Soup – the ability to execute JavaScript. Thus, this allows us to extract dynamically generated content which is exactly what we will do.

  Introduction to the requests-html package Exploring the capabilities of requests-html for Web Scraping Searching for text CSS selectors Scraping JavaScript