Linear regression is the most dynamic model out of all we review. It’s an exceptional framework for making predictions and extracting insight into relationships between variables.

One way to limit some of the negatives of linear regression is via regularization. We can regularize a linear regression model using ridge, lasso, and elastic net algorithms.

Like linear regression, logistic regression is one of the most powerful and straightforward models.

Gradient descent is an optimization algorithm that powers many of our ML algorithms. Think of it as a helper algorithm, enabling us to find the best formulation of our ML model.

Decision trees work for classification and regression problems. While individual decision trees don’t typically produce the best predictive outcomes in real life, they are highly interpretable.

Random forest is one of the most popular models for classification and regression. It works exceedingly well with datasets with many categorical values or a mix of categorical and continuous variables.

Gradient-boosted trees are a way for our models to learn from their mistakes. Unlike random forest—where we grow our trees in parallel, then aggregate the results—with gradient-boosted trees, we grow trees sequentially.

XGBoost is a famous open-source gradient-boosting algorithm for supervised learning tasks, including regression and classification problems. Reducing errors during each iteration makes better predictions by combining several decision trees.

K-nearest neighbors is a popular machine learning algorithm for classifying and predicting data. It works by finding the k closest data points to a new, unknown data point and categorizing it based on the most common class among its neighbors.

K-means clustering is the first unsupervised learning method we will introduce. As a reminder, unsupervised learning means that our data doesn’t have specific target labels we try to classify. Instead, we consider data as a whole and see algorithmically what groups can be made from it.

Hierarchical clustering is similar to how you organize files into folders on your computer. Whenever we organize our files into their folders, we perform hierarchical clustering.

Support vector machines (SVMs) work by identifying a hyperplane that best separates the data into different classes or predicts the target variable for regression. It also aims to find the optimal hyperplane that maximizes the margin between the classes while minimizing the misclassification error.

Artificial neural nets (ANNs) are machine learning algorithms based on the structure and function of biological neurons. Layers of interconnected nodes process and transform input data to produce predictions. The neural network learns by adjusting the weights and biases of the connections between the nodes based on the error of the predictions.

Collaborative filtering uses ratings from a group of (collaborative) users to infer the preference of another (filtering) user.

Discover the intricacies of the Naïve Bayes algorithm, exploring Bayes Theorem, its intuitive definition, why it's called "Naïve", the ML process, the pros and cons of this algorithm, a real-life business example, and effective use cases.

In this section you can find practical projects that will help you enhance your skills.