Posted by Sally on Tuesday, February 17, 2009 at 7:09am.
A machine is either working (state 1) or not workind (state 2). If it is working one day the probability that it will be broken the next day is 0.1. If it is not working one day the probability that it will be working the next day is 0.8. Let Tn be the state of the machine n days from now. Assume the Markov assumption is satisfied so that Tn is a Markov Chain.
-Find the eigenvalues and eigenvectors of P. And find a formula for P^n.
- math - Reiny, Tuesday, February 17, 2009 at 8:51am
If I recall Markov's chain, the matrix for the above would be
Is this called the transition matrix ?
The steady state vector, or eigenvector, is found by multiplying an initial probability vector by that transition vector and then using that resulting vector in your next multiplication.
This will eventually converge to a fixed vector, that is
[a b] times
.8 .2 equals [a b]
then .9a + .1b = a
and .8a + .2b = b
also a + b = 1 by the laws of probability.
solving this I got [.5 .5]
hope this helps, haven't done this stuff in years. I think the last time I taught this was over 20 years ago.
- CORRECTION: math - Reiny, Tuesday, February 17, 2009 at 9:30am
I made a fundamental error in my matrix multiplication
my equations should have been
.9a + .8b = a
and .1a + .2b = b
[a b] should have been [8/9 1/9]
Answer this Question
More Related Questions
- math - A machine is either working (state 1) or not workind (state 2). If it is ...
- Markov chains - A company has 2 machines. On any day, each machine that is ...
- Math- probability - In a city, every day is either cloudy or sunny (not both). ...
- discrete probability distribution (help please!) - a machine has 7 identical ...
- linear algebra - The weather on any given day in a particular city can be sunny...
- Elementary Statistics - A machine has 7 identical components which function ...
- stat - a machine has 7 identical components which function independently. the ...
- math - A machine has four components, A, B, C, and D, set up in such a manner ...
- math - The temperature in degree celcius in a factory during the course of a ...
- Math - the temperature in degree celcius in a factory during the course of a ...