K-Nearest Neighbors (page 1 of 6)

K-Nearest Neighbors (KNN) is a supervised machine learning algorithm that is primarily used for binary classification (2-categories) or multi-classification (more than 2 categories) problems. However, it may also be used to predict continuous targets. It is a supervised algorithm because we are constructing a predictive model from known targets.

KNN is one of the most basic machine learning algorithms that is intuitively clear. Despite its simplicity, however, it is still a powerful algorithm to construct predictive models. Remember the concept of Occam's Razor, which suggests that when presented with multiple explanations for the same phenomenon, we should select the simplest one.