Probability: Prior Distribution for a Continuous Variable

In summary, the prior distribution represents Jon's initial belief about θ and the posterior distribution is the updated belief after observing the actual value of x.
  • #1
Master1022
611
117
Homework Statement
When Jane started class, she warned Jon that she tends to run late. Not just late, but uniformly late. That is, Jane will be late to a random class by ##X## hours, uniformly distributed over the interval ##[0, \theta]##. Since the class is one hour long (fractions be banished!), Jon decides to model his initial belief about the unknown parameter ##\theta## by a uniform density from zero to one hour. (a) Jane was ##x## hours late to the first class. How should Jon update his belief about ##\theta##? In other words, find the posterior ##f(\theta|x)##. Roughly sketch the result for ##x = .2## and for ##x = .5##.
Relevant Equations
Probability
Hi,

I was attempting this problem from the MIT OCW website probability and statistics course.

Context: When Jane started class, she warned Jon that she tends to run late. Not just late, but uniformly late. That is, Jane will be late to a random class by ##X## hours, uniformly distributed over the interval ##[0, \theta]##. Since the class is one hour long (fractions be banished!), Jon decides to model his initial belief about the unknown parameter ##\theta## by a uniform density from zero to one hour. (a) Jane was ##x## hours late to the first class. How should Jon update his belief about ##\theta##? In other words, find the posterior ##f(\theta|x)##. Roughly sketch the result for ##x = .2## and for ##x = .5##.

Quick Question:
Why is the prior distribution ##d\theta##? I cannot seem to understand that.

Picture from the solution:
Screen Shot 2021-05-26 at 10.40.15 AM.png

Thanks
 
Physics news on Phys.org
  • #2
!The prior distribution ##d\theta## is the probability density function (PDF) of the uniform distribution over the interval [0, θ]. It represents Jon's initial belief about the unknown parameter θ. The posterior ##f(\theta|x)## is the PDF of the updated belief about θ after observing that Jane was x hours late to the first class. The posterior can be calculated as:##f(\theta|x) = \frac{f(x|\theta)f(\theta)}{f(x)}##where ##f(x|\theta)## is the PDF of the uniform distribution from 0 to θ and ##f(\theta)## is the prior distribution. For example, if Jane was 0.2 hours late to the first class, then the posterior would be:##f(\theta|0.2) = \frac{\frac{1}{\theta} \frac{1}{1}}{\frac{1}{0.2}} = \frac{5}{\theta}##which has a peak at 0.2 and decreases monotonically as θ increases. If Jane was 0.5 hours late to the first class, then the posterior would be:##f(\theta|0.5) = \frac{\frac{1}{\theta} \frac{1}{1}}{\frac{1}{0.5}} = \frac{2}{\theta}##which has a peak at 0.5 and decreases monotonically as θ increases.
 

FAQ: Probability: Prior Distribution for a Continuous Variable

What is a prior distribution for a continuous variable?

A prior distribution for a continuous variable is a probability distribution that represents our beliefs or knowledge about the possible values of the variable before we have observed any data. It is often used in Bayesian statistics to incorporate prior information into the analysis.

How is a prior distribution different from a probability distribution?

A prior distribution is different from a probability distribution in that it represents our assumptions or beliefs about a variable before we have observed any data, while a probability distribution describes the likelihood of different outcomes based on observed data.

How do you choose a prior distribution for a continuous variable?

Choosing a prior distribution for a continuous variable can be done in a few different ways. One approach is to use a non-informative prior, which assigns equal probability to all possible values. Another approach is to use a subjective prior, which is based on the researcher's beliefs or knowledge about the variable. A third approach is to use an informative prior, which incorporates previous research or data on the variable.

Can a prior distribution be updated with new data?

Yes, a prior distribution can be updated with new data using Bayesian methods. The updated distribution, called the posterior distribution, combines the prior distribution with the likelihood of the data to provide a more accurate representation of the variable's probability distribution.

What is the role of a prior distribution in Bayesian statistics?

In Bayesian statistics, the prior distribution plays a crucial role in incorporating prior knowledge or beliefs about a variable into the analysis. It allows for a more flexible and personalized approach to statistical inference compared to traditional frequentist methods.

Back
Top