Probability theoretic inequality

In summary, the Cauchy-Schwarz-Bunyakovsky inequality holds for any metric space and any two probability distributions, with equality occuring only when the expectation of p(x) and q(x) are the same.
  • #1
winterfors
71
0
Can anyone help me prove under what conditions on the distance function [tex]d(x_1,x_2)[/tex] the following inequality holds for any two probability distributions (represented by probability densities) [tex]p(x)[/tex] and [tex]q(x)[/tex] :

[tex]2\int{\int{d^2(x_1,x_2)p(x_1)q(x_2)dx_1dx_2}
\geq
\int{\int{d^2(x_1,x_2)p(x_1)p(x_2)dx_1dx_2} +
\int{\int{d^2(x_1,x_2)q(x_1)q(x_2)dx_1dx_2}
[/tex]

where [tex]d^2(x_1,x_2)[/tex] is the squared distance between [tex]x_1[/tex] and [tex]x_2[/tex] in some metric space [tex]\Theta[/tex]. All integrals are over [tex]\Theta[/tex].

One can easily verify by insertion that the inequality holds for a Euclidian metric where [tex]d^2(x_1,x_2)=(x_1-x_2)^2[/tex], with equality if and only if the expectation of [tex]p(x)[/tex] and [tex]q(x)[/tex] are the same.

It must surely hold for some more general class of metrics (described by [tex]d^2(x_1,x_2)[/tex]) - possibly all metrics - but I've so far failed to demonstrate it. Does anyone have an idea of how to prove it in some more general case?
 
Physics news on Phys.org
  • #2
The inequality is known as the Cauchy-Schwarz-Bunyakovsky inequality. It holds for any metric space and any two probability distributions (represented by probability densities) p(x) and q(x). The proof of this inequality relies on the fact that the integral of d^2(x_1,x_2)p(x_1)q(x_2) over all x_1 and x_2 is non-negative. This is true because d^2(x_1,x_2) is positive by definition, and p(x_1) and q(x_2) are both non-negative. Thus, one can apply the Cauchy-Schwarz inequality to the integrand to obtain the desired result:2\int{\int{d^2(x_1,x_2)p(x_1)q(x_2)dx_1dx_2} \geq \left(\int{\int{d(x_1,x_2)p(x_1)p(x_2)dx_1dx_2}\right)^2 + \left(\int{\int{d(x_1,x_2)q(x_1)q(x_2)dx_1dx_2}\right)^2
 

FAQ: Probability theoretic inequality

What is a probability theoretic inequality?

A probability theoretic inequality is a mathematical statement that relates the probabilities of different events. It is used to measure the likelihood of certain outcomes occurring and to compare the likelihood of different events happening.

What are some examples of probability theoretic inequalities?

Some examples of probability theoretic inequalities include the Cauchy-Schwarz inequality, the Markov inequality, and the Chebyshev inequality. These are commonly used in statistics and probability to establish bounds on the probabilities of certain events.

How are probability theoretic inequalities used in real-world applications?

Probability theoretic inequalities are used in various fields such as finance, economics, and engineering to make predictions and decisions based on probabilities. For example, the Markov inequality is used in risk analysis to determine the maximum amount of risk that an investor should be willing to take on.

What is the relationship between probability theoretic inequalities and probability distributions?

Probability theoretic inequalities are closely related to probability distributions, as they provide a way to compare the probabilities of different events within a distribution. In some cases, the inequalities can also be used to derive properties of the distribution itself.

Can probability theoretic inequalities be proven?

Yes, probability theoretic inequalities can be proven using mathematical techniques such as algebra, calculus, and probability theory. Proving these inequalities allows for a better understanding of their properties and can lead to further developments in the field of probability theory.

Similar threads

Replies
3
Views
737
Replies
6
Views
2K
Replies
6
Views
2K
Replies
3
Views
1K
Replies
12
Views
2K
Back
Top