Combining exponential distributions

In summary, the conversation discusses the combination of exponentially distributed random variables to express probabilities about certain events occurring within a given amount of time. An example is given with two independent train lines and their respective density and distribution functions. The question is raised about how to combine these functions to express the expected time until any train arrives or the probability of any train arriving within a specified time. The conversation eventually determines that the probability can be expressed as an exponential distribution with an expected arrival time of 2.22 minutes.
  • #1
gnome
1,041
1
Suppose I have several exponentially distributed random variables, each of them representing the probability that some particular event occurs within some amount of time. I can't seem to come up with any intuition as to how to combine those density functions (or distribution functions) to express probabilities about ANY of the events occurring.

To give a concrete example, say the A-train and the B-train arrive on separate tracks and their inter-arrival times are independent of each other, and let [tex]X[/tex] be the continuous rv representing the amount of time until a train arrives. Say the density functions and distribution functions for the two train lines are given by:
[tex]f_a(x) = \frac{1}{4} e^{-\frac{x}{4}} \qquad F_a(x) = 1 - e^{-\frac{x}{4}} \qquad \mbox{ for } x>0 \mbox{, and 0 otherwise}[/tex]
[tex]f_b(x) = \frac{1}{5} e^{-\frac{x}{5}} \qquad F_b(x) = 1 - e^{-\frac{x}{5}} \qquad \mbox{ for } x>0 \mbox{, and 0 otherwise}[/tex]

so the expected time until an A-train arrives [tex]E_a[x] = 4\mbox{ min.}[/tex]
and the expected time until a B-train arrives [tex]E_b[x] = 5\mbox{ min.}[/tex]
and it is easy to determine the probability for an A-train to arrive within any specific amount of time, and similarly for a B-train.

But how can those functions be combined into a single distribution to express the expected time [tex]E_{a|b}[x][/tex] until ANY train arrives, or the probability that ANY train will arrive within, say 2 minutes?
 
Physics news on Phys.org
  • #2
If two random variables are independent then:

P(a,b)=P(a)P(b)

Thus just multiply the distribution functions. You can also easily derive expressions for correlated random variables because you can use linear algebra to diagonalize the random variables and find a linear transformation between the correlated random variables and a new set of independent random variables.
 
  • #3
Running helps to clear the cobwebs.

John Creighto said:
If two random variables are independent then:

P(a,b)=P(a)P(b)

It's not the joint probability I'm looking for; that would be the probability that both an A-train and a B-train arrive by time x. I guess the probability I want may be called [tex]P_{a \cup \, b}(x)[/tex]. But here's what occurred to me. The probability that any train will arrive by time x is 1 minus the joint probability that (neither an A-train nor a B-train arrives by time x) so

[tex]
\begin{align*}
F(x) = P_{a \cup \, b}(x) &= 1 - e^{-\frac{x}{4}}e^{-\frac{x}{5}} \\
&= 1 - e^{-\frac{9x}{20}}
\end{align*}
[/tex]
and therefore just taking the derivative of that gives me
[tex]
f(x) = \frac{9}{20} e^{-\frac{9x}{20}}
[/tex]
which is an exponential distribution with an expectation of 20/9, i.e. the expected arrival time of some train, on either track, is about 2.22 minutes.

That seems plausible. Is it correct?
 
  • #4
gnome said:
Running helps to clear the cobwebs.
It's not the joint probability I'm looking for; that would be the probability that both an A-train and a B-train arrive by time x. I guess the probability I want may be called [tex]P_{a \cup \, b}(x)[/tex]. But here's what occurred to me. The probability that any train will arrive by time x is 1 minus the joint probability that (neither an A-train nor a B-train arrives by time x) so

[tex]
\begin{align*}
F(x) = P_{a \cup \, b}(x) &= 1 - e^{-\frac{x}{4}}e^{-\frac{x}{5}} \\
&= 1 - e^{-\frac{9x}{20}}
\end{align*}
[/tex]
and therefore just taking the derivative of that gives me
[tex]
f(x) = \frac{9}{20} e^{-\frac{9x}{20}}
[/tex]
which is an exponential distribution with an expectation of 20/9, i.e. the expected arrival time of some train, on either track, is about 2.22 minutes.

That seems plausible. Is it correct?

I don't think your right. Sorry for misreading it earlier. Here is what I think you want:

[tex]P(a \cup b)=P(a-ab)+P(ab)+P(b-ab)[/tex]

and I think (let met think about it though):

[tex]P(a-ab)=P(a)(1-P(b))[/tex]
[tex]P(b-ab)=P(b)(1-P(a))[/tex]edit: This seems to simplify to, P(a)+P(b)-2P(ab)
 
  • #5
I don't know what you mean by [tex]P(a), P(b), P(ab)[/tex], etc. I'm talking about the probability that an event a will occur within a specified amount of time x, the probability that event b will occur within that amount of time, and the probability that either event (don't care which) will occur within that amount of time. I may be wrong, but you appear to be thinking about whether a, b, or either event occurs at all, which is a completely different thing. (Where is the element of time in what you are suggesting?)

You seem to be trying to get to the general expression for probability of the union of two events, which is actually
[tex]P(A \cup \, B) = P(A) + P(B) - P(AB)[/tex]
but I don't see how that applies here.
 
  • #6
gnome said:
I don't know what you mean by [tex]P(a), P(b), P(ab)[/tex], etc. I'm talking about the probability that an event a will occur within a specified amount of time x, the probability that event b will occur within that amount of time, and the probability that either event (don't care which) will occur within that amount of time. I may be wrong, but you appear to be thinking about whether a, b, or either event occurs at all, which is a completely different thing. (Where is the element of time in what you are suggesting?)

You seem to be trying to get to the general expression for probability of the union of two events, which is actually
[tex]P(A \cup \, B) = P(A) + P(B) - P(AB)[/tex]
but I don't see how that applies here.
Thanks for the correction.

I'm going to clarify what I was thinking but I guess it turns out you were correct in your previous post. I didn't have much time to think about the problem in my past posts so I ended up not reading clearly and thinking it through enough.Let [tex]X_a[/tex] be the random variable that gives the time train A will arrive and [tex]X_b[/tex] be the random variable that gives the time train B will be arrive. We want to know if either train A or train B or both arived in a time less then t. Therefore we want

[tex]P(X_a<t \cup X_a<t) [/tex]

We should agree from the general expression for probability of the union that:

[tex]P(X_a<t \cup X_a<t)=P(X_a<t)+P(X_b<t) - P(X_b<t \cap X_a<t) [/tex]

Given the distributions are independent we can write:

[tex]F_{a \cup b}(t)=F_a(t)+F_b(t)-F_a(t)F_b(t)[/tex]
[tex]=( 1 - e^{-\frac{x}{4}})+(1 - e^{-\frac{x}{5}})-( 1 - e^{-\frac{x}{4}})(1 - e^{-\frac{x}{5}})[/tex]
[tex]=1-e^{-\frac{9x}{20}}[/tex]

Which is of course what you gave as the answer in your previous post. What I didn't realize is how you arrived at the answer since a few steps were left out.
 

FAQ: Combining exponential distributions

What is an exponential distribution?

An exponential distribution is a statistical probability distribution that describes the time between events in a Poisson process, such as the time between customer arrivals at a store or the time between radioactive decay events. It is often used to model events that occur randomly and independently over time.

How do you combine exponential distributions?

The sum of independent exponential distributions is also an exponential distribution, with a rate parameter equal to the sum of the individual rate parameters. This means that to combine exponential distributions, you simply add their rate parameters together.

What is the purpose of combining exponential distributions?

Combining exponential distributions allows for the modeling of more complex events or processes that involve multiple independent events occurring over time. It can also provide a more accurate representation of the overall distribution of event times.

Are there any limitations to combining exponential distributions?

Yes, combining exponential distributions assumes that the events are independent and occur at a constant rate. It also assumes that there are no other underlying factors that may affect the distribution, such as external factors or hidden variables.

How is the combined exponential distribution different from the individual distributions?

The combined exponential distribution will have a different rate parameter and shape than the individual distributions. The combined distribution will also have a larger spread and a longer tail, as it takes into account all the individual events from the separate distributions.

Similar threads

Back
Top