Calculating a probability if I'm given a conditional density function

In summary: The process is not Markov, as P(x,t|y,0) is not independent of x and y. Additionally, the probability that the walker will not get absorbed at x=B after an infinite amount of time is 0.
  • #1
fluidistic
Gold Member
3,926
262
1. Homework Statement +Relevant equations+Attempt at a solution
Hi, I'm stuck on a problem.
I have that [/itex]P(x,t|y,0)[/itex] represents the probability density that a function has the value x at time t knowing it had the value y at time [/itex]t_0=0[/itex] .
Where [itex]P(x,t|y,0)=\frac{1}{\sqrt{2\pi t}\sigma} \left[ \exp \{ - \frac{(x-y)^2}{2\sigma ^2 t} \} -\exp \{ - \frac{(x+y-2B)^2}{2\sigma ^2 t} \} \right][/itex]
Given [itex]B\geq x[/itex], [itex]B>y[/itex] and both x and y are not worth negative infinite, I'm interested in calculating the probability that the event will happen (i.e. that x=B) at some time.

Worded differently and adding some extra information, the mean time for the event to happen is infinite, nonetheless the probability for it to happen at some time is 1. I don't know how to prove the latter.
If I'm not wrong and I evaluated well the units, the units of [itex]P(x,t|y,0)[/itex] are [itex]1/\sqrt V[/itex]. While x and y have units of voltage (V).
 
Physics news on Phys.org
  • #2
So x is something fluctuating in time? If yes, how? The given probability distribution does not tell that. If I just evaluate it for enough values of t and assume that all of them are independent (I am quite sure they are not!), I would expect that I can get as close to 1 as I like (with 1 as limit).
 
  • #3
mfb said:
So x is something fluctuating in time? If yes, how? The given probability distribution does not tell that. If I just evaluate it for enough values of t and assume that all of them are independent (I am quite sure they are not!), I would expect that I can get as close to 1 as I like (with 1 as limit).
Yes x is basically the voltage of something. It fluctuates with time due to a white noise (so can't get the explicit x(t)).
The book I'm dealing with (Stochastic processes in biology) take a path I don't understand and doesn't deal with my exact case either.
 
  • #4
Hmm... assuming this P includes absorption at B (correct?), its integral should go to zero for large t. This should be easy to show.
 
  • #5
mfb said:
Hmm... assuming this P includes absorption at B (correct?), its integral should go to zero for large t. This should be easy to show.

Yes B is an absorbing point.
What integral exactly should go to zero exactly?

Edit: you mean integrating with respect to x and take the limit for when t tends to infinity?
 
  • #6
Right.
I expect that this is not possible in an analytic way, but an approximation is sufficient.
 
  • #7
fluidistic said:
1. Homework Statement +Relevant equations+Attempt at a solution
Hi, I'm stuck on a problem.
I have that [/itex]P(x,t|y,0)[/itex] represents the probability density that a function has the value x at time t knowing it had the value y at time [/itex]t_0=0[/itex] .
Where [itex]P(x,t|y,0)=\frac{1}{\sqrt{2\pi t}\sigma} \left[ \exp \{ - \frac{(x-y)^2}{2\sigma ^2 t} \} -\exp \{ - \frac{(x+y-2B)^2}{2\sigma ^2 t} \} \right][/itex]
Given [itex]B\geq x[/itex], [itex]B>y[/itex] and both x and y are not worth negative infinite, I'm interested in calculating the probability that the event will happen (i.e. that x=B) at some time.

Worded differently and adding some extra information, the mean time for the event to happen is infinite, nonetheless the probability for it to happen at some time is 1. I don't know how to prove the latter.
If I'm not wrong and I evaluated well the units, the units of [itex]P(x,t|y,0)[/itex] are [itex]1/\sqrt V[/itex]. While x and y have units of voltage (V).

Is the process Markov? Is it "stationary" in the sense that ##P(x,t|y,0) = P(x,t+s|y,s)## for any ##s > 0##? If these things hold you can try to develop a stochastic DE for X(t), then use Ito's Lemma to develop a differential equation for the absorption probability in terms of x---that is, for the probability that starting from x the process is absorbed eventually. If this material reads like gibberish to you, then I suspect you are being asked to solve a problem that needs tools far ahead of the material you have been shown so far.

As a hint: look up material on reflected Brownian motion; it looks to me like your density function is related to a process of that type. For example, you could start with http://en.wikipedia.org/wiki/Reflected_Brownian_motion . You should do your own search, as you may find articles much more suited to you requirements.
 
  • #8
mfb said:
Right.
I expect that this is not possible in an analytic way, but an approximation is sufficient.

I see. What about the following argument?:
Probability for a random walker not to be absorbed at x=B after an infinite amount of time is equal to ##\lim _{t\to \infty}\int _{-\infty}^B P(x,y,t)dx=\int_{-\infty}^B \underbrace {\lim _{t\to \infty} P(x,y,t)}_{=0}dx=0##.
Where the integrand is worth 0 because ##\lim _{t \to \infty} \frac{\exp (-a/t)- \exp (-b/t)}{\sqrt t}=0##.

And thus the solution to the original problem is 1. The event will happen (the random walker will get absorbed).

P.S.:I'm worried about the units of that integral. Square root of voltage. It should have no unit if it's meant to represent a probability.
 
  • #9
Ray Vickson said:
Is the process Markov? Is it "stationary" in the sense that ##P(x,t|y,0) = P(x,t+s|y,s)## for any ##s > 0##?
I don't really know if this hold. x represents the voltage of a cell which is under a white noise potential influence (with mean 0 and strength ##\sigma## or ##\sigma ^2##). If the potential of the cell reaches a threshold, the cell "fires". There is an event. In the model, the voltage threshold is "B" and with a finite amount of time, the voltage cannot reach ##-\infty##. I think the book states that -infinity is a reflection point and B is an absorbption point.
If these things hold you can try to develop a stochastic DE for X(t), then use Ito's Lemma to develop a differential equation for the absorption probability in terms of x---that is, for the probability that starting from x the process is absorbed eventually. If this material reads like gibberish to you, then I suspect you are being asked to solve a problem that needs tools far ahead of the material you have been shown so far.
I've seen in some books and on the web the word "Ito", but nothing else. So yes, I know I must catch up a lot to solve what I want.

As a hint: look up material on reflected Brownian motion; it looks to me like your density function is related to a process of that type. For example, you could start with http://en.wikipedia.org/wiki/Reflected_Brownian_motion . You should do your own search, as you may find articles much more suited to you requirements.
Yes, I think the same, thank you.
 
  • #10
fluidistic said:
I see. What about the following argument?:
You cannot exchange integration and the limit in that way. This is easier to see with a regular diffusion process, which would vanish in your calculation, too.


σ has to have units of ##\frac{voltage}{\sqrt{time}}##, otherwise your exponential functions do not work. Therefore, P has units 1/voltage, and integrating over voltage gives a dimensionless number.
 
  • #11
fluidistic said:
I don't really know if this hold. x represents the voltage of a cell which is under a white noise potential influence (with mean 0 and strength ##\sigma## or ##\sigma ^2##). If the potential of the cell reaches a threshold, the cell "fires". There is an event. In the model, the voltage threshold is "B" and with a finite amount of time, the voltage cannot reach ##-\infty##. I think the book states that -infinity is a reflection point and B is an absorbption point.
I've seen in some books and on the web the word "Ito", but nothing else. So yes, I know I must catch up a lot to solve what I want.


Yes, I think the same, thank you.

It seems like your process is Markov and stationary: Markov = future depends only on present, and not the past. Stationary: = dynamics is independent of when we decide to start; that is, it does not matter if "time zero" is 2 pm or 7 am or what. These ought to hold if the system is not being filtered by a device with a time constant (so that a high voltage, for example, takes a time to die down) and if the system does not possesses "hysteresis".

So, if your textbook's description is correct, you have a Brownian motion on ##(-\infty,B]## with zero drift and absorption at ##B##. On the web you may be able to find expressions related to Brownian motion on ##[0, \infty)## with absorption at ##0##. In that case your process is just a translation by ##B## and a switching of + and - directions, but is otherwise the same.

Anyway, if you accept without proof the expression for ##f(x,t) = P(x,t|y,0)##, then you have everything you need. To see this, let ##T## be the time (if ever) that the system is absorbed at level B. The function ##f(x,t)## gives the probability density for being at x at time t, so absorption cannot have happened yet. That is,
[tex] P\{ T > t \} = \int_{x=-\infty}^B f(x,t) \, dx[/tex]
because ##T > t## if and only if ##X(t) < B##. (Do you see why?) So, if you can do the integral (and it is doable in terms of the error function or the standard normal cdf) you can ask for the probability that the process is abserbed eventually; this is just ##P\{ T < \infty \}##.
 
Last edited:
  • #12
Ok guys I'm back to this topic for now.
I am still trying to solve (even with numerical help is welcome) $$\lim _{t\to \infty}\int _{-\infty}^B P(x,y,t)dx$$.
I cannot put the limit inside the integral as you pointed out. I evaluated numerically the indefinite integral ##\int \exp \left [ - \left ( \frac{1}{c} \right ) (x-a)^2 \right ] dx## to be worth ##\frac{\sqrt \pi }{\left ( \frac{2}{\sqrt c} \right )} \text{erf} \left ( \frac{1}{\sqrt c}x-a \right )##. Using this information I could evaluate the definite integral (by hand) to be worth ##\frac{\sqrt {\pi} \sigma }{\sqrt 2} \left [ 1 +\text{erf} \left ( \frac{B}{\sqrt {2t} \sigma} -y \right ) + 1 +\text{erf} \left ( \frac{B}{\sqrt {2t} \sigma} +2B -y \right ) \right ]##
Then, when I take the limit t tends to infinity, I get ##1+ \frac{\text{erf}(-y)+\text{erf}(2B-y)}{2}## which, quite unfortunately, differs from 0.

I do not know whether I made some mistake(s) or whether the value of the limit of the integral really differs from 0. Any comment is appreciated.
 

Related to Calculating a probability if I'm given a conditional density function

1. What is a conditional density function?

A conditional density function is a mathematical function that describes the probability distribution of a random variable, given that another random variable has taken on a specific value. It is used to calculate the probability of an event occurring under specific conditions.

2. How is a conditional density function different from a regular probability density function?

A regular probability density function describes the probability distribution of a single random variable, whereas a conditional density function describes the probability distribution of one variable, given the value of another variable. It takes into account the relationship between the two variables.

3. What information is needed to calculate a probability using a conditional density function?

In addition to the conditional density function, you will need the value of the variable that the probability is conditioned on, and the range of values for the other variable. These values will be used to calculate the probability using the formula for a conditional density function.

4. Can a conditional density function be used for any type of data?

Yes, a conditional density function can be used for any type of data as long as it follows a probability distribution. However, it is most commonly used for continuous data, such as height, weight, or time.

5. How do I interpret the results of a calculation using a conditional density function?

The result of a calculation using a conditional density function is a probability, which represents the likelihood of a specific event occurring under the given conditions. This probability can range from 0 to 1, where 0 indicates the event is impossible and 1 indicates the event is certain.

Similar threads

  • Calculus and Beyond Homework Help
Replies
19
Views
2K
  • Calculus and Beyond Homework Help
Replies
8
Views
267
  • Calculus and Beyond Homework Help
Replies
8
Views
336
  • Calculus and Beyond Homework Help
Replies
6
Views
1K
  • Calculus and Beyond Homework Help
Replies
3
Views
98
  • Calculus and Beyond Homework Help
Replies
1
Views
833
  • Calculus and Beyond Homework Help
Replies
1
Views
1K
  • Calculus and Beyond Homework Help
Replies
6
Views
276
  • Calculus and Beyond Homework Help
Replies
3
Views
1K
  • Calculus and Beyond Homework Help
Replies
8
Views
1K
Back
Top