Let X be a Markov chain containing an absorbing states with which all other states i communicate, in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.

Elementary Linear Algebra (MindTap Course List)
8th Edition
ISBN:9781305658004
Author:Ron Larson
Publisher:Ron Larson
Chapter2: Matrices
Section2.5: Markov Chain
Problem 47E: Explain how you can determine the steady state matrix X of an absorbing Markov chain by inspection.
icon
Related questions
Question
Let X be a Markov chain containing an absorbing states with which all other states i communicate,
in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.
Transcribed Image Text:Let X be a Markov chain containing an absorbing states with which all other states i communicate, in the sense that pis (n) > 0 for some n = n(i). Show that all states other than s are transient.
Expert Solution
steps

Step by step

Solved in 2 steps with 2 images

Blurred answer