Calculating Covariance with a Random Vector

In summary, the conversation discusses finding the covariance of two random variables, using the fact that the mean of the variables is 0 and the covariance matrix is an identity matrix. The solution involves finding the expected value of the product of the two variables, which is 1 in this case.
  • #1
ElijahRockers
Gold Member
270
10

Homework Statement


Let ##X## be a random variable such that ##\mu_X = 0## and ##K_{XX} = I##.
Find ##Cov(a^T X, b^T X)## for ##a = (1, 1, 0, 0)## and ##b = (0, 1, 1, 0)##.

The Attempt at a Solution


I guess I am assuming that ##X## is a 4 element random vector. I can't know values of the random variables, but I know their mean, and I think from ##K_{XX} = I## that
##E[X_i X_j] = 0, i≠ j##
##E[X_i X_j] = 1, i= j##

So..

##a^T X = X_1 + X_2 = A##
##b^T X = X_2 + X_3 = B##
##Cov(A,B) = E[AB]-E[A]E[ B]##

##E[A]## and ##E[ B]## are 0, so

##Cov(A,B) = E[AB] = E[X_1 X_2 + X_1 X_3 + X_2 X_2 + X_2 X_3]##

From ##K_{XX}##, ##E[AB] = E[X_2 X_2] = 1 = Cov(A,B)##

Not sure if this is correct or not.
 
Physics news on Phys.org
  • #2
ElijahRockers said:

Homework Statement


Let ##X## be a random variable such that ##\mu_X = 0## and ##K_{XX} = I##.
Find ##Cov(a^T X, b^T X)## for ##a = (1, 1, 0, 0)## and ##b = (0, 1, 1, 0)##.

The Attempt at a Solution


I guess I am assuming that ##X## is a 4 element random vector. I can't know values of the random variables, but I know their mean, and I think from ##K_{XX} = I## that
##E[X_i X_j] = 0, i≠ j##
##E[X_i X_j] = 1, i= j##

So..

##a^T X = X_1 + X_2 = A##
##b^T X = X_2 + X_3 = B##
##Cov(A,B) = E[AB]-E[A]E[ B]##

##E[A]## and ##E[ B]## are 0, so

##Cov(A,B) = E[AB] = E[X_1 X_2 + X_1 X_3 + X_2 X_2 + X_2 X_3]##

From ##K_{XX}##, ##E[AB] = E[X_2 X_2] = 1 = Cov(A,B)##

Not sure if this is correct or not.

It is correct if your interpretation of ##K_{XX}## is correct (which I cannot speak to because the notation is unfamiliar to me).
 
  • #3
Ray Vickson said:
It is correct if your interpretation of ##K_{XX}## is correct (which I cannot speak to because the notation is unfamiliar to me).
##K_{XX}## is the covariance matrix of ##X##, where ##K_{XX_{i,j}} = E[X_i X_j] - E[X_i]E[X_j]## is each element in the matrix... I believe.
 

FAQ: Calculating Covariance with a Random Vector

What is covariance with random vector?

Covariance with random vector is a statistical measure that describes how two random variables change together. It measures the strength and direction of the relationship between two random variables.

How is covariance with random vector calculated?

Covariance with random vector is calculated by taking the product of the differences between each variable and its mean, and then dividing by the number of observations.

What is the interpretation of a positive covariance?

A positive covariance indicates that the two variables have a positive relationship, meaning they tend to increase or decrease together. For example, as one variable increases, the other variable also tends to increase.

Can covariance with random vector be used to determine causation?

No, covariance with random vector only measures the strength and direction of the relationship between two variables. It does not provide information on causation, as other factors may be influencing the observed relationship.

How is covariance with random vector used in data analysis?

Covariance with random vector is often used in data analysis to understand the relationship between two variables. It can help identify patterns and trends in the data and can be used to select variables for further analysis or modeling.

Similar threads

Replies
3
Views
1K
Replies
9
Views
1K
Replies
9
Views
683
Replies
1
Views
1K
Replies
2
Views
2K
Replies
8
Views
2K
Replies
8
Views
990
Replies
3
Views
1K
Back
Top