Skip to content

Supervised Learning Algorithms#

Linear Models#

  • Linear Regression
  • Logistic Regression
  • Ridge Regression (L2 regularization)
  • Lasso Regression (L1 regularization)
  • Elastic Net

Support Vector Machines (SVMs)#

  • Support Vector Classifier
  • Support Vector Regressor

Nearest Neighbor Models#

  • K-Nearest Neighbors (KNN)

Decision Tree Based Models#

  • Decision Trees
  • Random Forests
  • Gradient Boosted Trees (e.g., XGBoost, LightGBM, CatBoost)
  • AdaBoost
  • Bagging

Probabilistic Models#

  • Naive Bayes
  • Gaussian Processes
  • Linear Discriminant Analysis (LDA)
  • Quadratic Discriminant Analysis (QDA)

Neural Network Models#

  • Multi-Layer Perceptrons (MLPs)
  • Convolutional Neural Networks (CNNs)
  • Recurrent Neural Networks (RNNs) / LSTMs
  • Transformers