You get a bonus - 1 coin for daily activity. Now you have 1 coin

8.6. Numerical characteristics of a system of two random variables. Correlation moment. Correlation coefficient

Lecture



In Chapter 5, we introduced into consideration the numerical characteristics of a single random variable.   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - the initial and central moments of different orders. Of these characteristics, the most important are two: the expectation   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and variance   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Similar numerical characteristics — the initial and central moments of different orders — can also be introduced for a system of two random variables.

Initial moment of order   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient systems   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient called the expectation of the work   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient on   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient :

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . (8.6.1)

Central point of order   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient systems   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient called the expectation of the work   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient th and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient th degree corresponding centered values:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.2)

Where   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

We write out the formulas that serve to directly count the moments. For discontinuous random variables

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.3)

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.4)

Where   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - the probability that the system   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient will take values   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , and summation is spread over all possible values ​​of random variables.   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

For continuous random variables:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.5)

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.6)

Where   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - the distribution density of the system.

Besides   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient characterizing the moment order with respect to individual quantities, the total moment order is also considered   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient equal to the sum of the exponents at   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . According to the total order, the moments are classified into first, second, etc. In practice, only the first and second moments are usually used.

The first initial moments are already known to us the expected values ​​of   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient Included in the system:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

Set of mathematical expectations   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient is a characteristic of the position of the system. Geometrically, these are the coordinates of the midpoint on the plane around which the point is scattered.   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Besides the first initial moments, the second central moments of the system are widely used in practice. Two of them are already known variances of quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient :

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

characterizing the dispersion of a random point in the direction of the axes   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

The second mixed central moment plays a special role as a characteristic of the system:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,

those. expectation of product of centered quantities.

In view of the fact that this moment plays an important role in the theory, we introduce a special designation for it:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . (8.6.7)

Characteristic   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient is called the correlation moment (otherwise - “moment of connection”) of random variables   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

For discontinuous random variables, the correlation moment is expressed by the formula

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.8)

and for continuous - by the formula

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . (8.6.9)

Find out the meaning and purpose of this characteristic.

Correlation moment is a characteristic of a system of random variables, describing, besides, the dispersion of quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , also the connection between them. In order to verify this, we prove that for independent random variables the correlation moment is zero.

The proof is carried out for continuous random variables. Let be   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - independent continuous quantities with distribution density   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . AT   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient 8.5 we proved that for independent variables

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . (8.6.10)

Where   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - distribution density, respectively   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Substituting the expression (8.6.10) into the formula (8.6.9), we see that the integral (8.6.9) turns into a product of two integrals:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Integral

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

is nothing but the first central moment of magnitude   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , and, therefore, is zero; for the same reason is zero and the second factor; hence for independent random variables   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Thus, if the correlation moment of two random variables is nonzero, this is a sign of the dependence between them.

From the formula (8.6.7) it can be seen that the correlation moment characterizes not only the dependence of the quantities, but also their dispersion. Indeed, if, for example, one of the quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient deviates very little from its expectation (almost non-random), then the correlation moment will be small, no matter how closely related the quantities are   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . Therefore, to characterize the relationship between the quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient pure pass from the moment   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient to dimensionless characteristic

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , (8.6.11)

Where   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - standard deviations of magnitudes   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ,   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . This characteristic is called the coefficient of correlation   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . Obviously, the correlation coefficient vanishes simultaneously with the correlation moment; therefore, for independent random variables, the correlation coefficient is zero.

Random variables for which the correlation moment (and, hence, the correlation coefficient) is equal to zero, are called uncorrelated (sometimes - “unrelated”).

Let us find out if the notion of uncorrelated random variables is equivalent to the notion of independence. We have proved above that two independent random variables are always uncorrelated. It remains to be seen: is the reverse situation true, does their independence follow from the uncorrelatedness of the values? It turns out - no. It is possible to construct examples of such random variables that are uncorrelated, but dependent. The equality to zero of the correlation coefficient is a necessary, but not sufficient condition for the independence of random variables. Independence of random variables implies their uncorrelatedness; on the contrary, their independence does not follow from the uncorrelated values. The condition of independence of random variables is more stringent than the condition of uncorrelatedness.

We will see this with an example. Consider a system of random variables   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient distributed with uniform density inside the circle   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient radius   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient centered at the origin (Fig. 8.6.1).

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

Fig.8.6.1

Distribution density   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient expressed by the formula

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

From the condition   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient we find   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

It is easy to verify that in this example, the values ​​are dependent. Indeed, it is immediately clear that if the magnitude   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient took, for example, the value 0, then the value   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient can equally well take all values ​​from   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient before   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ; if the quantity   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient took meaning   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient then quantity   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient can take only one single value, exactly zero; in general, the range of possible values   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient depends on what value took   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

Let's see if these values ​​are correlated. Calculate the correlation moment. Bearing in mind that for symmetry reasons   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , we get:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . (8.6.12)

To calculate the integral, we divide the integration domain (the circle   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient ) into four sectors   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient corresponding to the four coordinate angles. In sectors   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient integrand is positive in sectors   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - negative; in their absolute value, the integrals for these sectors are equal; therefore, the integral (8.6.12) is zero, and the quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient not correlated.

Thus, we see that random variables do not always follow from the uncorrelatedness of random variables.

The correlation coefficient characterizes not every dependence, but only the so-called linear dependence. The linear probabilistic dependence of random variables is that as one random variable increases, the other tends to increase (or decrease) according to a linear law. This tendency towards linear dependence may be more or less pronounced, more or less approximate to functional, i.e., the closest linear dependence. The correlation coefficient characterizes the degree of closeness of the linear relationship between random variables. If random values   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient linked by an exact linear functional dependence:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

that   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and the plus or minus sign is taken depending on whether the coefficient is positive or negative.   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient . In general, when the quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient linked by an arbitrary probabilistic dependence, the correlation coefficient may have a value within:

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient .

When   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient speak of a positive correlation of magnitudes   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , when   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient - about negative correlation. A positive correlation between random variables means that as one increases, the other tends to increase on average; a negative correlation means that as one of the random variables increases, the other tends to decrease on average.

In the considered example, two random variables   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient distributed inside a circle with a uniform density, despite the existence of a relationship between   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient and   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , linear dependence is absent; with increasing   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient only the range of change changes   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient , and its mean value does not change; naturally quantities   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient turn out to be uncorrelated.

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

Fig. 8.6.2 Fig.8.6.3

Let us give some examples of random variables with positive and negative correlation.

1. Weight and height of a person are associated with a positive correlation.

2. The time spent on adjusting the device when preparing it for work, and the time of its trouble-free operation are associated with a positive correlation (if, of course, time is spent wisely). On the contrary, the time spent on preparation and the number of faults detected during operation of the device are associated with a negative correlation.

3. When firing a volley, the coordinates of the points of hit of individual projectiles are associated with a positive correlation (since there are common aiming errors for all shots, each deviating from the target equally).

4. Two shots are fired at the target; the point of entry of the first shot is recorded, and an amendment is introduced into the scope proportional to the error of the first shot with the opposite sign. The coordinates of the hit points of the first and second shots will be associated with a negative correlation.

If we have at our disposal the results of a series of experiments on a system of random variables   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient then it is easy to judge about the presence or absence of a significant correlation between them in the first approximation according to the graph, which shows all the pairs of random values ​​obtained from the experience as points. For example, if the observed pairs of values ​​of values ​​are arranged as shown in Fig. 8.6.2, this indicates the presence of a pronounced positive correlation between the quantities. An even more pronounced positive correlation, close to a linear functional dependence, is observed in Fig. 8.6.3. In fig. 8.6.4 shows a case of relatively weak negative correlation. Finally, in fig. 8.6.5 illustrates the case of practically uncorrelated random variables. In practice, before investigating the correlation of random variables, it is always useful to preliminarily construct the observed pairs of values ​​on the graph for the first qualitative judgment on the type of correlation.

  8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient   8.6.  Numerical characteristics of a system of two random variables.  Correlation moment.  Correlation coefficient

Fig. 8.6.4 Figure 8.6.5

Methods for determining the characteristics of a system of random variables from experiments will be covered in Chapter 14.


Comments


To leave a comment
If you have any suggestion, idea, thanks or comment, feel free to write. We really value feedback and are glad to hear your opinion.
To reply

Probability theory. Mathematical Statistics and Stochastic Analysis

Terms: Probability theory. Mathematical Statistics and Stochastic Analysis