How is MAP Computed for a Multivariate Gaussian?

In summary, the standard multivariate gaussian is given by a mathematical formula, which can be found on Wikipedia. The parameters for this distribution can be estimated using maximum-likelihood estimation, as explained on Wikipedia. In order to compute the MAP or "mode" for a multivariate gaussian, an iterative optimization algorithm such as gradient descent must be used, as the mode is the point at which the gradient of the log-likelihood of the model is zero.
  • #1
mort.motes
2
0
The standard multivariate gaussian is given by:

http://upload.wikimedia.org/math/1/c/d/1cd250fc27ef7b7a9da469416333d07f.png

taken from:

http://en.wikipedia.org/wiki/Multivariate_normal_distribution

The parameters can be estimated using:

http://en.wikipedia.org/wiki/Estima...tion_for_the_multivariate_normal_distribution

and:

http://en.wikipedia.org/wiki/Normal_distribution#Estimation_of_parameters

But given those parameters how are MAP (maximum posterior) or the "mode" computed? Again from wiki: "The parameter μ is at the same time the mean, the median and the mode of the normal distribution"

In a bayes context MAP can somtimes be estimated as:

MAP = ML*Prior
 
Last edited:
Physics news on Phys.org
  • #2
where ML is the maximum likelihood estimate and Prior is the prior estimate.However, for a multivariate gaussian, it is not as straightforward as for a single variable gaussian. For a multivariate gaussian, MAP can be found by using an iterative optimization algorithm such as gradient descent. This is because the mode of a multivariate gaussian is the point at which the gradient of the log-likelihood of the model is zero.
 

FAQ: How is MAP Computed for a Multivariate Gaussian?

What is MAP for multivariate gaussian?

MAP for multivariate gaussian is a statistical method used to estimate the parameters of a multivariate gaussian distribution. It stands for Maximum A Posteriori and is a type of Bayesian inference.

How is MAP for multivariate gaussian different from other estimation methods?

Unlike other estimation methods, MAP for multivariate gaussian takes into account prior knowledge about the parameters of the distribution. This prior knowledge is represented by a prior distribution and is combined with the data to obtain a more accurate estimate.

What is the formula for calculating MAP for multivariate gaussian?

The formula for calculating MAP for multivariate gaussian involves multiplying the likelihood function with the prior distribution and maximizing the resulting expression with respect to the parameters of the distribution.

What are the benefits of using MAP for multivariate gaussian?

MAP for multivariate gaussian allows for the incorporation of prior knowledge, which can result in more accurate estimates of the parameters of the distribution. It also provides a measure of uncertainty through the posterior distribution.

Are there any limitations to using MAP for multivariate gaussian?

One limitation of MAP for multivariate gaussian is that it assumes the prior distribution and the likelihood function are independent. This may not always be the case in real-world scenarios. Additionally, MAP estimates may be sensitive to the choice of prior distribution.

Back
Top