Linearizing Patterns Using Extra Dimensions
Overview
The
perceptron
is designed to recognize linear patterns. When the patterns
are not linear, the perceptron may still be used when the pattern can be transformed first into a linear pattern.
Demo
The following is a graph of a sample non linear pattern. The points divided into two categories. One category is a circular shape, and the second category
consists of points outside that circle. As can be seen, no single line can be drawn to separate the two sets of points.
The dataset can be transformed into a 3 dimensional set that can be separated by a plane. Here, we add a third dimension to each point which represents
its distance to the origin in the original graph. When displayed, the data now appears as points on the surface of a cone.