Transience of MC: Proving b>=1

  • Thread starter Thread starter alphabeta1989
  • Start date Start date
Click For Summary
The discussion focuses on proving the transience of a Markov chain defined by a Poisson distribution with mean dependent on the previous state. Participants suggest using a superharmonic function to establish transience when the parameter b is greater than or equal to 1. Several attempts to find suitable superharmonic functions, including exponential forms, are deemed unsuccessful. A key point raised is the necessity of understanding the implications of a superharmonic function in the context of the Markov chain. A simple solution proposed is using the function φ(x) = -x, which satisfies the superharmonic condition under the specified parameters.
alphabeta1989
Messages
3
Reaction score
0
1. Homework Statement
Consider the following model.

X_{n+1} given X_n, X_{n-1},...,X_0 has a Poisson distribution with mean \lambda=a+bX_n where a>0,b\geq{0}. Show that X=(X_n)_{n\in\mathrm{N_0}} is a transient M.C if b\geq 1.2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let X be an irreducible Markov chain with countable state space S. A necessary and sufficient condition for X to be transient is the existence of a non-constant, non-negative super-harmonic function \phi.
3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for b\geq 1 Thanks in advance.
 
Last edited:
Physics news on Phys.org
alphabeta1989 said:
1. Homework Statement
Consider the following model.

X_{n+1} given X_n, X_{n-1},...,X_0 has a Poisson distribution with mean \lambda=a+bX_n where a>0,b\geq{0}. Show that X=(X_n)_{n\in\mathrm{N_0}} is a transient M.C if b\geq 1.


2. Homework Equations

How do we approach this question? I was thinking of using the theorem below.

Let X be an irreducible Markov chain with countable state space S. A necessary and sufficient condition for X to be transient is the existence of a non-constant, non-negative super-harmonic function \phi.



3. The Attempt at a Solution
I was thinking of using an exponential function as a superharmonic function, but failed terribly. What superharmonic function can we use to prove transcience for b\geq 1 Thanks in advance.

Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.
 
Ray Vickson said:
Something is missing: you have included no statement about what happens to/with the super-harmonic function ##\phi## in the context of ##X##.

I attempted to use functions such as \phi(x) = e^{bx}, e^{(b-1)x}, but all of them are not superharmonic w.r.t X. What type of functions should I attempt?
 
alphabeta1989 said:
I attempted to use functions such as \phi(x) = e^{bx}, e^{(b-1)x}, but all of them are not superharmonic w.r.t X. What type of functions should I attempt?

You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!
 
Ray Vickson said:
You are missing the whole point: WHAT is supposed to happen if I give you a superharmonic function? You quoted only half of a theorem; the other half is vital!

I am sorry about that! This is the definition of a superharmonic function!

Let X be a time-homogeneous irreducible Markov chain with countable state space S and one-step transition probability matrix P(x, y). A function \phi: S \rightarrow R is said to be superharmonic for X at x \in S if \sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)
 
alphabeta1989 said:
I am sorry about that! This is the definition of a superharmonic function!

Let X be a time-homogeneous irreducible Markov chain with countable state space S and one-step transition probability matrix P(x, y). A function \phi: S \rightarrow R is said to be superharmonic for X at x \in S if \sum_{y\in S} P(x,y)\phi(y)\leq\phi(x)

If you don't care about signs, just getting a superharmonic ##\phi## is easy: in this case, ##\phi(x) = -x## is superharmonic if ##a>0,\: b \geq 1##. However, if you want a non-negative ##\phi## it is harder. You can follow the construction in
http://math.stackexchange.com/questions/165913/markov-chains-recurrence-and-transcience
 
Question: A clock's minute hand has length 4 and its hour hand has length 3. What is the distance between the tips at the moment when it is increasing most rapidly?(Putnam Exam Question) Answer: Making assumption that both the hands moves at constant angular velocities, the answer is ## \sqrt{7} .## But don't you think this assumption is somewhat doubtful and wrong?

Similar threads

  • · Replies 7 ·
Replies
7
Views
2K
  • · Replies 11 ·
Replies
11
Views
3K
Replies
4
Views
2K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 12 ·
Replies
12
Views
2K
Replies
1
Views
2K
Replies
10
Views
2K
  • · Replies 3 ·
Replies
3
Views
2K
  • · Replies 9 ·
Replies
9
Views
2K
Replies
2
Views
2K