You get a bonus - 1 coin for daily activity. Now you have 1 coin

Nearest Neighbor Method. Potential function method

Lecture



Neighbor Neighbor Method

Training in this case is to memorize all the objects of the training sample. If an unrecognized object is presented to the system   Nearest Neighbor Method.  Potential function method then she relates this object to that image (Fig. 7), whose “representative” was the closest to   Nearest Neighbor Method.  Potential function method .

  Nearest Neighbor Method.  Potential function method

Fig. 6. Example of linearly inseparable sets

  Nearest Neighbor Method.  Potential function method

Fig. 7. Decision rule "Minimum distance
to the nearest neighbor "

This is the nearest neighbor rule. Rule   Nearest Neighbor Method.  Potential function method the closest neighbors is that a volume hypersphere is built   Nearest Neighbor Method.  Potential function method centered on   Nearest Neighbor Method.  Potential function method . Recognition is carried out on the majority of "representatives" of any image who are inside the hypersphere. Here the subtlety consists in correctly (reasonably) choosing the volume of the hypersphere.   Nearest Neighbor Method.  Potential function method should be large enough so that a relatively large number of “representatives” of different images fall into the hypersphere, and small enough so as not to smooth out the nuances of the border separating the images. The method of nearest neighbors has the disadvantage that it requires the storage of the entire training sample, and not its generalized description. But he gives good results on the control tests, especially with large numbers of objects presented for training.

To reduce the number of memorized objects, you can apply combined decision rules, for example, a combination of the method of fragmented standards and the nearest neighbors.

In this case, those objects that fall into the zone of intersection of hyperspheres of any level are subject to memorization. The method of nearest neighbors applies only to those recognizable objects that fall into this intersection zone. In other words, not all the objects of the training sample are subject to memorization, but only those that are near the border separating the images.

Potential function method

The name of the method is to some extent related to the following analogy (for simplicity, we assume that two images are recognized). Imagine that objects are points.   Nearest Neighbor Method.  Potential function method some space   Nearest Neighbor Method.  Potential function method . Charges will be placed at these points.   Nearest Neighbor Method.  Potential function method if the object belongs to the image   Nearest Neighbor Method.  Potential function method and   Nearest Neighbor Method.  Potential function method if the object belongs to the image   Nearest Neighbor Method.  Potential function method (Fig. 8).

  Nearest Neighbor Method.  Potential function method

Fig. 8. Illustration of potential function synthesis
in the process of studying:

  Nearest Neighbor Method.  Potential function method

The function describing the distribution of the electrostatic potential in such a field can be used as a decision rule (or for its construction). If the potential point   Nearest Neighbor Method.  Potential function method generated by a single charge located in   Nearest Neighbor Method.  Potential function method equal to   Nearest Neighbor Method.  Potential function method then the total potential in   Nearest Neighbor Method.  Potential function method created by   Nearest Neighbor Method.  Potential function method charges equal to

  Nearest Neighbor Method.  Potential function method

  Nearest Neighbor Method.  Potential function method - potential function. It, as in physics, decreases with increasing Euclidean distance between   Nearest Neighbor Method.  Potential function method and   Nearest Neighbor Method.  Potential function method . Most often, a potential is used as a potential function that has a maximum at   Nearest Neighbor Method.  Potential function method and monotonously decreasing to zero with   Nearest Neighbor Method.  Potential function method .

Recognition can be carried out as follows. At the point   Nearest Neighbor Method.  Potential function method where the unidentified object is located, the potential is calculated   Nearest Neighbor Method.  Potential function method . If it is positive, then the object is attributed to the image.   Nearest Neighbor Method.  Potential function method . If negative - to the image   Nearest Neighbor Method.  Potential function method .

With a large training sample size, these calculations are rather cumbersome, and it is often more advantageous to calculate not   Nearest Neighbor Method.  Potential function method and evaluate the boundary separating classes (images) or approximate a potential field.

Choosing the type of potential functions is not easy. For example, if they decrease very rapidly with increasing distance, then it is possible to achieve an unmistakable separation of training samples. However, this causes certain troubles when recognizing unidentified objects (the reliability of the decision is reduced, the zone of uncertainty increases). With too flat potential functions, the number of recognition errors may unreasonably increase, including on training objects. Certain recommendations in this regard can be obtained by considering the method of potential functions from statistical positions (restoration of the probability distribution density   Nearest Neighbor Method.  Potential function method or dividing the boundary of the sample using a procedure like stochastic approximation). This question is beyond the scope of this course of lectures.


Comments


To leave a comment
If you have any suggestion, idea, thanks or comment, feel free to write. We really value feedback and are glad to hear your opinion.
To reply

Pattern recognition

Terms: Pattern recognition