# Markov chains

posted by
**Denise** on
.

A company has 2 machines. On any day, each machine that is working has a 1/3 chance of breaking down. If a machine breaks down during the day, it is sent to a repair facility and will be working 2 days after it breaks down. Letting the state of the system be the number of machines working at the beginning of the day, formulate a transition probability matrix for this situation.