Week 12: Attention and Transformer

Announcements

Tuesday

Recitation

  • Single algorithms, LDA, SVM, KNN, and their variations etc.

  • Ensemble methods, Random Forest, Boosting, Voting, and their variations etc.

  • Deep learning, CNN, RNN, Transformer, and their variations etc.

Classification (Supervised Learning)

  • Linear Discriminant Analysis (LDA)

  • Support vector machine (SVM)

  • Nearest Neighbors

  • Decision Trees

  • Ensemble Methods (Random Forest, boosting, bagging, Voting)

Regression (Supervised Learning)

  • Linear Regression

  • Ridge Regression

  • Lasso Regression

Clustering (Unsupervised Learning)

  • Overview of clustering methods

  • K-means

  • Hierarchical clustering

  • DBSCAN

Thursday

No Class today

  • Thanksgiving break

  • But you can prepare for your finals if you like

Deep Learning

  • CNN

  • RNN (LSTM)

  • Attention (Transformer)

Dataset

  • Iris

  • Diabetes

  • MNIST

  • EEGEyeNet