What is Probability theory: Definition and 113 Discussions
Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set of axioms. Typically these axioms formalise probability in terms of a probability space, which assigns a measure taking values between 0 and 1, termed the probability measure, to a set of outcomes called the sample space. Any specified subset of these outcomes is called an event.
Central subjects in probability theory include discrete and continuous random variables, probability distributions, and stochastic processes, which provide mathematical abstractions of non-deterministic or uncertain processes or measured quantities that may either be single occurrences or evolve over time in a random fashion.
Although it is not possible to perfectly predict random events, much can be said about their behavior. Two major results in probability theory describing such behaviour are the law of large numbers and the central limit theorem.
As a mathematical foundation for statistics, probability theory is essential to many human activities that involve quantitative analysis of data. Methods of probability theory also apply to descriptions of complex systems given only partial knowledge of their state, as in statistical mechanics or sequential estimation. A great discovery of twentieth-century physics was the probabilistic nature of physical phenomena at atomic scales, described in quantum mechanics.
So I'd like to "integrate out" the ##x##-variable, like $$f_Y(y)=\int_0^1 \mathbf{1}_{(0,x)}(y)\frac1x\,dx.$$ I am a bit hesitant on how to proceed, since I feel like I will get an unbounded density. Something's fishy, but I don't know what.
Questions:
1. I am a bit unsure why ##g(x)=h(x)##. Clearly ##g(x)\geq h(x)##, but why is ##g(x)\leq h(x)##? Here's my explanation, which is kind of lengthy, but maybe you have a better one.
If ##(a,b)\in\mathcal E_{\varphi}## is such that ##\varphi(x)>ax+b## for all ##x\in\mathbb R##, then...
I am reading a proof of Jensen's inequality. The proof goes like this.
I do not know much about convex functions, but why does (1) hold?
The definition of convex I'm using is that $$\varphi(tx+(1-t)y)\leq t\varphi(x)+(1-t)\varphi(y)$$ holds for all ##x,y\in\mathbb R## and all ##t\in[0,1]##.
I feel like I'm doing something wrong. I have computed $$E(Y\mid X=x)=\int_\mathbb{R}y f_{Y\mid X=x}\, dy,$$with pen and paper, and I get the same that WolframAlpha gets, namely ##0##. Can this be right? If this is indeed true, then is ##E(Y\mid X)=E(E(Y\mid X))=0## too?
How do I go about...
I'm working through an exercise to prove various identities of the conditional expectation. One of the identities I need to show is the following $$E(f(X,Y)\mid Y=y)=E(f(X,y)\mid Y=y).$$ But I am a little concerned about this identity from things I've read elsewhere. I am paraphrasing from...
Let ##(\Omega,\mathcal{F},P)## be a probability space, and let us define the conditional expectation ##{\rm E}[X\mid\mathcal{G}]## for integrable random variables ##X:\Omega\to\mathbb{R}##, i.e. ##X\in L^1(P)##, and sub-sigma-algebras ##\mathcal{G}\subseteq\mathcal{F}##.
If...
I don't really know how to approach this problem, but my plan is to find ##p_{X,Y}(x,y)=P(X=x,Y=y)##. The two conditions ##X=x## and ##Y=y## in terms of ##U_1## and ##U_2## read (I think) $$U_1=y,U_2 = x-y \text{ or }U_2 = y, U_1 = x-y,\qquad x\geq 2y.$$ So $$P(X = x, Y = y) = \begin{cases}...
This is the follow-up problem to my previous problem.
"Integrating out" the ##y##-variable and ##x##-variable separately, we see that ##f_Y(y)=2## and ##f_X(x)=\min(1,x)-\max(0,x-1)##. From my previous post, we see that ##X## is the sum of two independent ##U(0,1)##-distributed r.v.s. What is...
Let's recall the densities of ##X## and ##Y##:
\begin{align}
f_X(x)=\mathbf{1}_{(0,1)}(x), \quad f_Y(y)=\frac{1}{\alpha}\mathbf{1}_{(0,\alpha)}(y)
\end{align}
Let ##z\in (0,1+\alpha)##. So we know that ##f_Z(z)## is given by:
\begin{align}
f_Z(z)=\int_\mathbb{R} f_X(t)f_Y(z-t)\,dt
\end{align}...
I'm reading this article on transformation of random variables, i.e. functions of random variables. We have a probability space ##(\Omega, \mathcal F, P)## and measurable spaces ##(S, \mathcal S)## and ##(T, \mathcal T)##. We have a r.v. ##X:\Omega\to S## and a measurable map ##r:S\to T##. Then...
I'm tempted to write the joint density ##f_{XYZ}## as $$f_{XYZ}(x,y,z)=\begin{cases}\frac1{4\pi}&\text{if }x^2+y^2+z^2=1, \\ 0&\text{otherwise.}\end{cases}$$However, from other sources, I've read that a uniform distribution on the unit sphere does not have a density in three variables. If this...
Hi,
in the Karhunen–Loève theorem's statement the random variables in the expansion are given by $$Z_k = \int_a^b X_te_k(t) \: dt$$
##X_t## is a zero-mean square-integrable stochastic process defined over a probability space ##(\Omega, F, P)## and indexed over a closed and bounded interval ##[a...
Some time ago we had a discussion of the sleeping beauty problem
https://www.physicsforums.com/threads/the-sleeping-beauty-problem-any-halfers-here.916459/
which is a well known problem in probability theory. In that thread, there was no consensus whether the probability of heads is 1/2 or 1/3...
A recent question about interpretations of probability nicely clarified the role of the Kolmogorov axioms:
[... some excursions into QM, negative probabilities, and quasiprobability distributions ...]
Conclusion: the Kolmogorov axioms formalize the concept of probability. They achieve this by...
Mathematics uses Lebesgue measure for probability theory. However it is well known that it comes with a flaw that is not all sets are measurable. Is there a reason why the choice is also preferred in physics?
For concretness I'll use atoms and photons but this problem is actually just about probabilities.
There's an atom A whose probability to emit a photon between times t and t+dt is given by a gaussian distribution probability P_A centered around time T_A with variance V_A. There's a similar atom...
I am interested in stomach acid and heat expansion, for instance the stomach will become heated due to an athelete competing. The heat causes atheletes to live shorter than people who don't have their body heated so often. I do a lot of differential equations and number theory, but I was...
I submitted this solution, and it was marked incorrect. Could I get some feedback on where I went wrong?
Let S represent the event that Party A wins the senate and H represent the event that Party A wins the house.
There are 4 cases: winning the senate and house (##S \cap H##), winning just...
I got (a) and (b) but I'm still working on (c). The solutions can be found here for your reference: https://ocw.mit.edu/courses/electrical-engineering-and-computer-science/6-041sc-probabilistic-systems-analysis-and-applied-probability-fall-2013/unit-ii/lecture-9/MIT6_041SCF13_assn05_sol.pdf. But...
I tried to derive the right hand side of the Radon-Nikodym derivative above but I got different result, here is my attempt:
\begin{equation} \label{eq1}
\begin{split}
\frac{\mathrm d\mu_{\Theta\mid X}}{\mathrm d\mu_\Theta}(\theta \mid x) &= f_{\Theta\mid X}(\theta\mid x) \mathrm \space...
Because I do have a background in the latter it was originally very difficult for me to understand some aspects of QP (quantum physics) when I initially learned it. More specifically whenever probabilities were involved I couldn’t really make full sense of it while I never had any problems...
Homework Statement
Let ##U_1, U_2, U_3## be independent uniform on ##[0,1]##.
a) Find the joint density function of ##U_{(1)}, U_{(2)}, U_{(3)}##.
b) The locations of three gas stations are independently and randomly placed along a mile of highway. What is the probability that no two gas...
Homework Statement
Hi all, I have some difficulty understanding the following problem, help is greatly appreciated!
Let ##U_1, U_2, U_3## be independent random variables uniform on ##[0,1]##. Find the probability that the roots of the quadratic ##U_1 x^2 + U_2 x + U3## are real.
Homework...
Homework Statement
[/B]
Hi all, I have an issue understanding the concepts pertaining to the following problem, assistance is greatly appreciated.
I understand the "flow" of the problem; first find the probability of obtaining balls of the same colour, then use the geometric distribution...
Homework Statement
Discrete random variables ##X,Y,Z## are mutually independent if for all ##x_i, y_j, z_k##,
$$P(X=x_i \wedge Y=y_j \wedge Z=z_k ) = P(X=x_i)P(Y=y_j)P(Z=z_k )$$
I am trying to show (or trying to understand how someone has shown) that ##X,Y## are also independent as a result...
Homework Statement
Hi all, could someone give my working a quick skim to see if it checks out? Many thanks in advance.
Suppose that 5 cards are dealt from a 52-card deck. What is the probability of drawing at least two kings given that there is at least one king?Homework Equations
The Attempt...
<Moderator's note: Moved from homework.>
Hi all, I have an issue understanding a statement I read in my text.
It first states the following Proposition (Let's call it Proposition A):
The number of unordered samples of ##r## objects selected from ##n## objects without replacement is ##n...
Suppose I am trying to approximate a function which I do not know, but I can measure. Each measurement takes a lot of effort.
Say the function I am approximating is ##y=f(x)## and ##x \in [0,100]##
Supose I know the expectation and variance of ##f(x)##.
Is there a way to compute the confidence...
Hi everyone.
As a graduate student in statistics, I had taken a graduate course in measure-theoretic probability theory. In a conversation with the professor, he had remarked that if I wanted to pursue further research on some of the topics covered, it may be wise to do background reading or...
Homework Statement
Homework Equations
All needed are in the picture above (i hope so)
The Attempt at a Solution
to me it is extremely difficult because it is so complicated with many notations. Also, I actually don't know how to read the question properly to answer it
Is E(beta) is the...
Homework Statement
The time (minute) that it takes for a terrain runner to get around a runway is a random variable X with the tightness function
fX = (125-x)/450 , 95≤x≤125
How big is the probability of eight different runners, whose times are independent after 100 minutes:
a) Everyone has...
Homework Statement
In a vessel is a 5 cent coin and two 1-cent coins. If someone takes up two randomly chosen of these coins, and we let X be the total value of the coins taken, what is the probability function for X?
Homework Equations
I know that X has a value {2,6}
The Attempt at a...
Homework Statement
Prove the continuity from below theorem.
Homework EquationsThe Attempt at a Solution
So I've defined my {Bn} already and proven that it is a sequence of mutually exclusive events in script A. I need to prove that U Bi (i=1 to infinity) is equal to U Ai (i=1 to infinity) to...
Hello everyone!
I'm studying the physics of complex systems and I'm approaching probability theory.
I understand that we need a ## \sigma-algebra ## and the Kolmogorov axioms in order to define a probability space but then I bumped into the following relation:
$$ p(A_1 \cup A_2 ) = p( A_1 ) + p(...
I study control theory and robotics. Recently I figured out that I have a much deeper understanding of probability and statistics compared to my colleagues. Is this 'talent' valuable in my field and if so, where? We used this theory to define white noise, but nothing more...as of now.
Also I am...
Hi All
This is in relation to the folllowing paper:
https://arxiv.org/pdf/1402.6562.pdf
See section 3 on examples where standard probability theory is discussed. Is it valid? To me its rather obvious but I had had a retired professor of probability say probability theory doesn't have a state...
Su, Francis, et. al. have a short description of the paradox here: https://www.math.hmc.edu/funfacts/ffiles/20001.6-8.shtmlI used that link because it concisely sets forth the paradox both in the basic setting but also given the version where the two envelopes contain ( \,\$2^k, \$2^{k+1}) \...
Would you please introduce me some textbooks that offer multiple choice or true-false questions at the end of each chapter so I can practice before my final exam? Basically, that class I am taking right now cover many central topics in Undergraduate Probability course such as:
• Moments and...
In another math thread
https://www.physicsforums.com/threads/categorizing-math.889809/
several people expressed their opinion that, while statistics is a branch of applied mathematics, the probability theory is pure mathematics and a branch of analysis, or more precisely, a branch of measure...
Hi,
I am looking for a book for studying probability theory using measure theory. This is the first course I am taking of probability. Notions and theorems from measure theory are part of this course.
As it turns out, this is a catastrophic disaster, and the textbook for this course is also not...
Dear Physics Forum personnel,
I would like to seek your recommendation on a good, introductory textbook in the probability theory (non measure-theoretic treatment) that contains both the applied and theoretical treatment of the subject. My goal is to advance into the measure-theoretic...
Homework Statement
3. The Attempt at a Solution [/B]
*****************************************
Can anyone possibly explain step 3 and 4 in this solution?
Homework Statement
Calculate the limit
$$lim_{s,t→∞} R_X(s, s+t) = lim_{s,t→∞}E(X(s)X(s+t))$$
for a continuous time Markov chain
$$(X(t) ; t ≥ 0)$$
with state space S and generator G given by
$$S = (0, 1)$$
$$ G=
\begin{pmatrix}
-\alpha & \alpha \\
\beta & -\beta\...
Homework Statement
Let $$(X(n), n ∈ [1, 2])$$ be a stationary zero-mean Gaussian process with autocorrelation function
$$R_X(0) = 1; R_X(+-1) = \rho$$
for a constant ρ ∈ [−1, 1].
Show that for each x ∈ R it holds that
$$max_{n∈[1,2]} P(X(n) > x) ≤ P (max_{n∈[1,2]} X(n) > x)$$
Are there any...
Homework Statement
Let X(t) be a birth-death process with parameters
$$\lambda_n = \lambda > 0 , \mu_n = \mu > 0,$$
where
$$\lambda > \mu , X(0) = 0$$
Show that the
total time T_i spent in state i is
$$exp(\lambda−\mu)-distributed$$
3. Solution
I have a hard time understanding this...
This question is killing me.
I know the graph is non-monotonic so i have to split up finding F(Y) for -1<Y and Y<1 but then what do I do with the modulus? >.<
Any help would be greatly appreciated! Thank you so much x
Homework Statement
An only child Urška puts 3 pieces of paper into a bag : on each piece of paper is written a name of one of her classmates :David,Niko,Dejan (those are the 3 names): She then randomly picks 2 pieces of paper from the bag and checks them
Match the statements on the right with...
Prove or disprove the following statement:
If p(a)=p(b)=q then p(a∩b)≤q2
We know nothing know about event a , b.
The Attempt at a Solution
I tried this but don't know correct or not
Can some one help me
let a, b are independent event
0<q<1
then p(a∩b) = p(a) p(b) = q*q = q^2
[/B]