# probability

Problem 3: Checking the Markov property

For each one of the following definitions of the state Xk at time k (for k=1,2,…), determine whether the Markov property is satisfied by the sequence X1,X2,….

A fair six-sided die (with sides labelled 1,2,…,6) is rolled repeatedly and independently.

(a) Let Xk denote the largest number obtained in the first k rolls. Does the sequence X1,X2,… satisfy the Markov property?

Yes - correct

(b) Let Xk denote the number of 6's obtained in the first k rolls, up to a maximum of ten. (That is, if ten or more 6's are obtained in the first k rolls, then Xk=10.) Does the sequence X1,X2,… satisfy the Markov property?
Yes - correct

(c) Let Yk denote the result of the kth roll. Let X1=Y1, and for k≥2, let Xk=Yk+Yk−1. Does the sequence X1,X2,… satisfy the Markov property?
No - correct

(d) Let Yk=1 if the kth roll results in an odd number; and Yk=0 otherwise. Let X1=Y1, and for k≥2, let Xk=Yk⋅Xk−1. Does the sequence X1,X2,… satisfy the Markov property?
Yes - correct

Let Yk be the state of some Markov chain at time k (i.e., it is known that the sequence Y1,Y2,… satisfies the Markov property).

(a) For a fixed integer r>0, let Xk=Yr+k. Does the sequence X1,X2,… satisfy the Markov property?
Yes - correct

(b) Let Xk=Y2k. Does the sequence X1,X2,… satisfy the Markov property?
Yes - correct

(c) Let Xk=(Yk,Yk+1). Does the sequence X1,X2,… satisfy the Markov property?
Yes - correct

1. 👍
2. 👎
3. 👁

Belonging to this very same problem set....

1.a. False

1.b. False

2.a. False

2.b. False

3.a. True

3.b. True

1. 👍
2. 👎

## Similar Questions

1. ### Math

Which property is illustrated by the statement. (2+3.4) + 6 = 2 + (3.4 + 6) Associative property of addition (i chose this) Commutative property of multipliction Inverse property of multiplication Commutative property of addition

2. ### Math

State the property that justifies the statement: If 3x = 6, then x = 2. A. Subtraction Property of Equality B. Addition Property of Equality C. Division Property of Equality D. Multiplication Property of Equality*** Can you please

1 Which property is used in the equation below? 12(x + 4) = 12x + 48 A Associative Property of Addition B Commutative Property of Addition C Distributive Property D Reflexive Property 2 Which expression is equivalent to 3 x – 3

4. ### algebra

Name the property of real numbers illustrated by the equation 2·(8·7)=(2·8)·7 answers are distributive property, Associative property multiplication, Communicative property multiplication , Associative property addition

1. ### Math

which property is shown by 0+9=9 A.) Distributive Property B.) Commutative Property of Addition C.) Identity Property of Addition D.) Associative Property of Addition I think its A but I'm not really sure

2. ### math.

Which property is shown by 4+(5+6)=(4+5)+6 ? A. Communitive property of addition B.Distributive property C.Additive identity D.Associative property of addition Is the answer D?

1. Which statement is an example of Identity Property of multiplication? A. 8x0=0 B. 8x1=8 C. 8x-1=-8 D. -8x-1=8 2. What is another way to write 3x(4+7)? A. 3x4+7 B. 3x4x7 C. 3x4+4x7 D. (3x4)+(3x7) 3. Which property is represented

4. ### math

Which property is shown by 2+0=2? A. Associative property of addition B. Commutative property of addition C. Distributive property D. Identity property of addition Is the answer B?

1. ### Algebra A

write a short story problem that can be solved in one step. Write an equation that represents the problem. Name the property used to solve the problem, and then solve the problem. PLEASE HELP WITH THIS ASAP!!!

2. ### Algebra2

Name the property of real numbers for -2(x+4)=-2x-8 associative property of multiplication communitive property of addition distributive property associate property of addition my answer is distributive property